00000001:02000400:3.0F:1788970067.972430:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788970087.651714:0:3526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788970089.485741:0:3588:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 935 MB/s 00000001:01000000:0.0:1788970089.736249:0:3588:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 575 MB/s 00000001:01000000:2.0:1788970089.987618:0:3588:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3325 MB/s 00000020:02000000:1.0F:1788970090.839797:0:3617:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_42_gf11d80b 00000400:02000000:2.0:1788970091.687365:0:3633:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.115@tcp [8/256/0/180] 00008000:02000000:3.0:1788970094.865364:0:3782:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788970168.333230:0:5751:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788970181.505947:0:6501:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788970181.505953:0:6501:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788970181.505954:0:6501:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788970181.506085:0:6501:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c164a55f 00000080:02000400:1.0:1788970181.506095:0:6501:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788970181.526602:0:6501:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788970181.526616:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788970181.526659:0:6501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007a8373f5) 00000020:00000080:1.0:1788970181.526682:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788970181.600232:0:6501:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788970181.600296:0:6501:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788970181.635254:0:6501:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788970181.635493:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788970181.635500:0:6501:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788970181.635510:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e35a 00000020:01000004:0.0:1788970181.635517:0:6501:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788970181.635522:0:6501:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788970181.635526:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c164a55f from MGS 00000020:01000004:0.0:1788970181.635530:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788970181.635552:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000487b6046) 00000020:00000080:0.0:1788970181.635563:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788970181.635668:0:6501:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c164a55f from MGS, refs=2 00080000:01000000:0.0:1788970181.635686:0:6501:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788970181.635692:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e368 00000100:00100000:0.0:1788970181.635807:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788970181.635930:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788970181.635937:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788970181.639979:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788970181.639989:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788970181.640596:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970181.640772:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788970181.640787:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788970181.641464:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788970181.641471:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788970181.642001:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788970181.642008:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788970181.642568:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970181.642572:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970181.642573:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970181.652887:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970181.652893:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970181.652895:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970181.657276:0:6501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788970181.664637:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788970181.906570:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2223 MB/s 00000001:01000000:2.0:1788970182.156557:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2351 MB/s 00000001:01000000:2.0:1788970182.406911:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 983 MB/s 00000001:01000000:2.0:1788970182.656987:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 915 MB/s 00080000:10000000:2.0:1788970182.663542:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788970182.673839:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788970182.674587:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788970182.674749:0:6501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788970182.674808:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788970182.674961:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788970182.674983:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788970182.675311:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970182.675522:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788970182.675529:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788970182.676361:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788970182.676368:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788970182.676822:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788970182.676829:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788970182.677440:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788970182.677461:0:6501:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.115@tcp' 00000020:01000004:3.0:1788970182.677463:0:6501:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788970182.677547:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.115@tcp (typ=mgc) 00000020:00000080:3.0:1788970182.677572:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.115@tcp (00000000c2e7cc11) 00000020:00000080:3.0:1788970182.677587:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788970182.677744:0:6501:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003fdcd9cb@MGC192.168.203.115@tcp: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970182.677949:0:6501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.115@tcp-0 is initialized 00000040:01000000:3.0:1788970182.677955:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788970182.678520:0:6519:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788970182.679867:0:6521:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788970182.680233:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.115@tcp (uuid 5fe147a8-4210-48cf-8358-c541b06e4cd0) 00000020:00000080:2.0:1788970182.680258:0:6501:0:(genops.c:1384:class_connect()) connect: client 5fe147a8-4210-48cf-8358-c541b06e4cd0, cookie 0xc3abfebe76c6e376 00000100:00080000:2.0:1788970182.680269:0:6501:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970182.680279:0:6501:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import 000000003fdcd9cb using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970182.680309:0:6501:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000044d90f1f x1875871102140544/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970182.680335:0:6501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS 00000020:01000004:2.0:1788970182.680351:0:6501:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788970182.680356:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788970182.680376:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000003e0ac3) 00000020:00000080:2.0:1788970182.680416:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788970182.683911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044d90f1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102140544:0@lo:250: 00000100:00100000:0.0:1788970182.684001:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970182.684112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102140544 00000100:00100000:0.0:1788970182.684120:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102140544 00000100:00100000:0.0:1788970182.684155:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970182.684162:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cfc0a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1875871102140544:12345-0@lo:250: 00010000:00080000:0.0:1788970182.684188:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5fe147a8-4210-48cf-8358-c541b06e4cd0@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1788970182.684222:0:6516:0:(genops.c:1384:class_connect()) connect: client 5fe147a8-4210-48cf-8358-c541b06e4cd0, cookie 0xc3abfebe76c6e384 00000100:00080000:0.0:1788970182.684363:0:6516:0:(import.c:65:import_set_state_nolock()) 000000004e18e134 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970182.684433:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cfc0a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:3648:x1875871102140544:12345-0@lo:250: Request processed in 271us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970182.684441:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970182.684497:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788970182.684506:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.115@tcp: connect to target with instance 0 00000100:00080000:0.0:1788970182.684514:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788970182.684519:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788970182.684522:0:3648:0:(import.c:65:import_set_state_nolock()) 000000003fdcd9cb MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788970182.684524:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788970182.684531:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788970182.684535:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044d90f1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102140544:0@lo:250: 00010000:00010000:1.0:1788970182.687922:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970182.699893:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970182.700105:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788970182.700112:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788970182.700890:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788970182.700898:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788970182.701107:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788970182.701125:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788970182.701681:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970182.701880:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788970182.701886:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788970182.703661:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788970182.703673:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788970182.766478:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970182.766725:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788970182.766732:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788970182.768355:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788970182.768368:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788970182.769273:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970182.769751:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788970182.769757:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788970182.770812:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788970182.770822:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788970182.771812:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970182.771993:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788970182.771998:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788970182.772727:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788970182.772734:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788970182.775078:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970182.775333:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788970182.775338:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788970182.777966:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970182.777979:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788970182.801844:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970182.802043:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970182.802057:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788970182.804752:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970182.804776:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788970182.809543:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788970182.809561:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788970182.813155:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788970182.813220:0:6501:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788970182.813227:0:6501:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970182.813324:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970182.813357:0:6501:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788970182.813362:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970182.813364:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970182.813365:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970182.813367:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970182.813368:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970182.813373:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970182.813374:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970182.813376:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970182.813377:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970182.813532:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970182.813533:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970182.813535:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970182.813537:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788970182.813540:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970182.813541:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970182.813542:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970182.813543:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970182.813544:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970182.813545:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970182.813546:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970182.813547:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970182.813547:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970182.813548:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970182.813549:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970182.813550:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788970182.815638:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788970182.815663:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102140672:0@lo:253: 00000100:00100000:2.0:1788970182.815760:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970182.815856:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af887c05 going to sleep for 11 seconds 00000100:00100000:0.0:1788970182.819702:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102140672 00000100:00100000:0.0:1788970182.819715:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102140672 00000100:00100000:0.0:1788970182.819775:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970182.819783:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e2b3275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6501:x1875871102140672:12345-0@lo:253: 20000000:01000000:0.0:1788970182.819842:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788970182.819845:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788970182.820955:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788970182.821025:0:6518:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788970182.821328:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970182.822461:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788970182.822838:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788970182.822842:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788970182.822847:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788970182.822850:0:6518:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788970182.822863:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788970182.823010:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970182.823147:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788970182.823159:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788970182.823174:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788970182.823186:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788970182.823197:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788970182.823238:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788970182.823244:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788970182.823255:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788970182.823260:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788970182.823269:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788970182.823273:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788970182.823282:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788970182.823294:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788970182.823311:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788970182.823315:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788970182.823320:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970182.823677:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788970182.823691:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788970182.823706:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788970182.823718:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788970182.823730:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788970182.823738:0:6518:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788970182.825134:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788970182.825161:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788970182.825182:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788970182.825198:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788970182.825212:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788970182.825226:0:6518:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788970182.825267:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788970182.825276:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788970182.825290:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788970182.825307:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788970182.825363:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788970182.825416:0:6518:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788970182.825424:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788970182.827320:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788970182.833264:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788970182.833299:0:6518:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.115@tcp for mdt 20000000:01000000:0.0:1788970182.833301:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:0.0:1788970182.833317:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788970182.833324:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788970182.833337:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788970182.833342:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:0.0:1788970182.833354:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788970182.833361:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788970182.833372:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788970182.833539:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788970182.833576:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788970182.833580:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788970182.833583:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788970182.833656:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788970182.833659:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788970182.836048:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788970182.836265:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788970182.836309:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788970182.836327:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788970182.836341:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788970182.836343:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788970182.836899:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788970182.837034:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788970182.837055:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788970182.837071:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788970182.837083:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970182.837086:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788970182.837091:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788970182.837093:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788970182.837098:0:6518:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788970182.837104:0:6518:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788970182.837363:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788970182.840573:0:6518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788970182.850902:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788970182.850947:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788970182.850961:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788970182.851004:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788970182.851028:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851049:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851059:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851076:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851083:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851089:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851095:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098a4612f already unused, calling callback (000000007bcbfd51) 00010000:00010000:1.0:1788970182.851099:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851107:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851123:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851131:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.851136:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098a4612f/0xc3abfebe76c6e38b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788970182.851159:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788970182.863786:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e2b3275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6501:x1875871102140672:12345-0@lo:253: Request processed in 43996us (48018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970182.863809:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970182.864108:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102140672:0@lo:253: 10000000:01000000:0.0:1788970182.864133:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788970182.864137:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970182.864139:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788970182.864141:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970182.864142:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788970182.864144:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970182.864145:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970182.864146:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970182.864148:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788970182.864150:0:6501:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788970182.864151:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970182.864153:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970182.864186:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c164a55f from lustre-MDT0000 10000000:01000000:0.0:1788970182.864230:0:6501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788970182.864233:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788970182.864238:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a7e848519c0 10000000:01000000:0.0:1788970182.864242:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970182.864264:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7e848519c0 from 1 10000000:01000000:0.0:1788970182.864267:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788970182.864318:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.864330:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.864341:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970182.864363:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102140800:0@lo:101: 00000100:00100000:0.0:1788970182.864492:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970182.864574:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f229b88 going to sleep for 11 seconds 00000100:00100000:0.0:1788970182.864602:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102140800 00000100:00100000:0.0:1788970182.864610:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102140800 00000100:00100000:0.0:1788970182.864660:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970182.864668:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062814369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6501:x1875871102140800:12345-0@lo:101: 00010000:00010000:0.0:1788970182.864684:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970182.864699:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e392 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.864724:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.864735:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.864744:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7d3a04c, rc 0) 00000100:00100000:0.0:1788970182.864789:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062814369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:6501:x1875871102140800:12345-0@lo:101: Request processed in 122us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970182.864804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970182.864847:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102140800:0@lo:101: 00010000:00010000:0.0:1788970182.864863:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.864875:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970182.864939:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102140928:0@lo:501: 00000100:00100000:0.0:1788970182.864966:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970182.864990:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f229b88 going to sleep for 11 seconds 00000100:00100000:3.0:1788970182.865085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102140928 00000100:00100000:3.0:1788970182.865098:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102140928 00000100:00100000:3.0:1788970182.865154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970182.865162:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7b3d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:6501:x1875871102140928:12345-0@lo:501: 00000100:00100000:3.0:1788970182.865291:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7b3d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:6501:x1875871102140928:12345-0@lo:501: Request processed in 131us (324us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970182.865298:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970182.865427:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102140928:0@lo:501: 10000000:01000000:1.0:1788970182.865492:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788970182.865733:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.865746:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970182.865755:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7eb0d2c000 10000000:01000000:1.0:1788970182.865760:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788970182.865774:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a7eb0d2c000 10000000:01000000:1.0:1788970182.865777:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788970182.865780:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a7eb0d2c000 from 1 10000000:01000000:1.0:1788970182.865783:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788970182.865813:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.865821:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.865829:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970182.865848:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141056:0@lo:101: 00000100:00100000:1.0:1788970182.865885:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970182.865926:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086212240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970182.865947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141056 00000100:00100000:0.0:1788970182.865958:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141056 00000100:00100000:0.0:1788970182.866089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970182.866098:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000130a3365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:6501:x1875871102141056:12345-0@lo:101: 00010000:00010000:0.0:1788970182.866114:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970182.866131:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090c193f5/0xc3abfebe76c6e3a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e3a0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.866153:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090c193f5/0xc3abfebe76c6e3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e3a0 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.866163:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090c193f5/0xc3abfebe76c6e3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e3a0 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.866172:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090c193f5, rc 0) 00000100:00100000:0.0:1788970182.866234:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000130a3365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+7:6501:x1875871102141056:12345-0@lo:101: Request processed in 138us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970182.866257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970182.867088:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141056:0@lo:101: 00010000:00010000:1.0:1788970182.867109:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.867137:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970182.867161:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788970182.868891:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.868916:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000098a4612f/0xc3abfebe76c6e3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970182.868926:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788970182.868936:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970182.868945:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a7eb0d2c000 10000000:01000000:1.0:1788970182.868948:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788970182.868952:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788970182.868955:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788970182.869006:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.869014:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.869026:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970182.869053:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141184:0@lo:101: 00000100:00100000:1.0:1788970182.869139:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970182.869189:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086212240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970182.869276:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141184 00000100:00100000:0.0:1788970182.869285:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141184 00000100:00100000:0.0:1788970182.869344:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970182.869353:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000687d0bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+7:6501:x1875871102141184:12345-0@lo:101: 00010000:00010000:0.0:1788970182.869370:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970182.869523:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e3ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.869773:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.869786:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970182.869796:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000679610fd, rc 0) 00000100:00100000:0.0:1788970182.869854:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000687d0bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+8:6501:x1875871102141184:12345-0@lo:101: Request processed in 502us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970182.869861:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970182.869965:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141184:0@lo:101: 00010000:00010000:2.0:1788970182.869982:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970182.869991:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970182.870075:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a51684c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141312:0@lo:501: 00000100:00100000:2.0:1788970182.870122:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970182.870154:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f1ec289 going to sleep for 11 seconds 00000100:00100000:0.0:1788970182.870202:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141312 00000100:00100000:0.0:1788970182.870207:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141312 00000100:00100000:0.0:1788970182.870238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970182.870245:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000273e9247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+8:6501:x1875871102141312:12345-0@lo:501: 00000100:00100000:3.0:1788970182.870562:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a51684c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141312:0@lo:501: 00000100:00100000:3.0:1788970182.870637:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141440:0@lo:503: 00000100:00100000:0.0:1788970182.870637:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000273e9247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6501:x1875871102141312:12345-0@lo:501: Request processed in 135us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970182.870661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970182.870747:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970182.870808:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6e10250 going to sleep for 11 seconds 00000100:00100000:2.0:1788970182.870810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141440 00000100:00100000:2.0:1788970182.870819:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141440 00000100:00100000:2.0:1788970182.870858:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970182.870864:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081190428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6501:x1875871102141440:12345-0@lo:503: 00000100:00100000:2.0:1788970182.870975:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081190428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6501:x1875871102141440:12345-0@lo:503: Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970182.870982:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970182.871077:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141440:0@lo:503: 00000100:00100000:2.0:1788970182.871910:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6546:1875871102141568:0@lo:502: 00000100:00100000:2.0:1788970182.871972:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970182.872012:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d82f7dc6 going to sleep for 11 seconds 00000100:00100000:0.0:1788970182.872096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141568 00000100:00100000:0.0:1788970182.872104:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141568 00000100:00100000:0.0:1788970182.872152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970182.872159:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1a2305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6546:x1875871102141568:12345-0@lo:502: 00000100:00100000:0.0:1788970182.872290:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1a2305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6546:x1875871102141568:12345-0@lo:502: Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970182.872299:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970182.872700:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6546:1875871102141568:0@lo:502: 00000020:01000000:3.0:1788970182.872744:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970182.872759:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970182.872762:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788970182.872799:0:6546:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788970182.872803:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970182.872821:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009af5c39d) 00000020:00000080:3.0:1788970182.872845:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788970182.872853:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788970182.873503:0:6546:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788970182.873515:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e3c3 00000020:00000080:3.0:1788970182.874031:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788970182.874039:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970182.874045:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970182.874047:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788970182.874050:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970182.874056:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970182.874057:0:6546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788970182.874060:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970182.874069:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004f2793b1) 00000020:00000080:3.0:1788970182.874083:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788970182.874087:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788970182.874089:0:6546:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788970182.874093:0:6546:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788970182.874099:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970182.874156:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c164a55f from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788970182.874168:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000dde66874) 00000020:00000080:3.0:1788970182.874175:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788970182.874268:0:6546:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788970182.874275:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e3d8 00000020:00000080:3.0:1788970182.874369:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788970182.874375:0:6546:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788970182.875069:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3abfebe76c6e3df 00080000:01000000:3.0:1788970182.875084:0:6546:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788970182.875099:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e3e6 00080000:10000000:3.0:1788970182.876301:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788970182.877152:0:6546:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788970182.883071:0:6546:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788970183.012416:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788970183.012958:0:6546:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788970183.016493:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788970183.017068:0:6546:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788970183.025010:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ca5b38dd) 00000020:00000080:0.0:1788970183.025043:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788970183.025200:0:6546:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788970183.025210:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e3f4 00000020:00000080:0.0:1788970183.029971:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788970183.031050:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788970183.034006:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788970183.042263:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788970183.049010:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788970183.051854:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788970183.054583:0:6546:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788970183.056856:0:6546:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3abfebe76c6e3fb 00000020:00000080:2.0:1788970183.057255:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788970183.057271:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970183.057277:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970183.057280:0:6546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788970183.057283:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970183.057288:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970183.057289:0:6546:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970183.057292:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970183.057294:0:6546:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788970183.057297:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970183.057299:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970183.057300:0:6546:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788970183.057309:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970183.057314:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970183.057315:0:6546:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788970183.057319:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788970183.057377:0:6546:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788970183.057473:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003337edbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6546:1875871102141696:0@lo:502: 00000100:00100000:2.0:1788970183.057567:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970183.057628:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e78f8aa5 going to sleep for 11 seconds 00000100:00100000:1.0:1788970183.057794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141696 00000100:00100000:1.0:1788970183.057803:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141696 00000100:00100000:1.0:1788970183.057857:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970183.057867:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000354fcb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6546:x1875871102141696:12345-0@lo:502: 00000100:00100000:1.0:1788970183.058004:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000354fcb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6546:x1875871102141696:12345-0@lo:502: Request processed in 138us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970183.058012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970183.058119:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003337edbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6546:1875871102141696:0@lo:502: 00000020:01000000:2.0:1788970183.058151:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970183.058156:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970183.058158:0:6546:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788970183.058161:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788970183.058483:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788970183.058508:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788970183.058535:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.058548:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970183.058557:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7eb0d2c000 from 1 10000000:01000000:1.0:1788970183.058560:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970183.058597:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.058606:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.058616:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970183.058633:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b43b6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141824:0@lo:101: 00000100:00100000:1.0:1788970183.058741:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970183.058779:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041dd04b8 going to sleep for 11 seconds 00000100:00100000:2.0:1788970183.058909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141824 00000100:00100000:2.0:1788970183.058916:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141824 00000100:00100000:2.0:1788970183.058955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970183.058963:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c5fa2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:6501:x1875871102141824:12345-0@lo:101: 00010000:00010000:2.0:1788970183.058974:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970183.058992:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e402 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970183.059017:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970183.059029:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970183.059039:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029f66050, rc 0) 00000100:00100000:2.0:1788970183.059085:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c5fa2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:6501:x1875871102141824:12345-0@lo:101: Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970183.059102:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970183.059174:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b43b6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141824:0@lo:101: 00010000:00010000:3.0:1788970183.059190:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.059200:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970183.059895:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141952:0@lo:256: 00000100:00100000:3.0:1788970183.059950:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970183.059976:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c403cd48 going to sleep for 11 seconds 00000100:00100000:1.0:1788970183.060068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102141952 00000100:00100000:1.0:1788970183.060082:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102141952 00000100:00100000:1.0:1788970183.060129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970183.060136:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba835 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:6501:x1875871102141952:12345-0@lo:256: 20000000:01000000:1.0:1788970183.060155:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788970183.060163:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788970183.060235:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba835 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:6501:x1875871102141952:12345-0@lo:256: Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970183.060242:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970183.060476:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102141952:0@lo:256: 10000000:01000000:3.0:1788970183.061245:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970183.061312:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.061327:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970183.061337:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0d2c000 from 1 10000000:01000000:3.0:1788970183.061340:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970183.061489:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.062144:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.062155:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970183.062180:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142080:0@lo:101: 00000100:00100000:3.0:1788970183.062248:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970183.062293:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c403cd48 going to sleep for 11 seconds 00000100:00100000:1.0:1788970183.062657:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142080 00000100:00100000:1.0:1788970183.062722:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142080 00000100:00100000:1.0:1788970183.062789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970183.062798:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a541d8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:6501:x1875871102142080:12345-0@lo:101: 00010000:00010000:1.0:1788970183.062816:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970183.062834:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.062861:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.062870:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.062879:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2e956bd, rc 0) 00000100:00100000:1.0:1788970183.062927:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a541d8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6501:x1875871102142080:12345-0@lo:101: Request processed in 131us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970183.062935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970183.063048:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142080:0@lo:101: 00010000:00010000:0.0:1788970183.063065:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.063074:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970183.063159:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257184dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142208:0@lo:501: 00000100:00100000:0.0:1788970183.063188:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970183.063221:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000000216a6f3 going to sleep for 11 seconds 00000100:00100000:3.0:1788970183.063282:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142208 00000100:00100000:3.0:1788970183.063286:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142208 00000100:00100000:3.0:1788970183.063318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970183.063324:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dcda7507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6501:x1875871102142208:12345-0@lo:501: 00000100:00100000:3.0:1788970183.063535:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dcda7507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6501:x1875871102142208:12345-0@lo:501: Request processed in 211us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970183.063542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970183.063656:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257184dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142208:0@lo:501: 00000100:00100000:0.0:1788970183.063761:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257184dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142336:0@lo:503: 00000100:00100000:0.0:1788970183.063824:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970183.063845:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 000000000216a6f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788970183.063918:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142336 00000100:00100000:1.0:1788970183.063923:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142336 00000100:00100000:1.0:1788970183.063955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970183.063969:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fba393a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6501:x1875871102142336:12345-0@lo:503: 00000040:00080000:1.0:1788970183.064006:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970183.064047:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fba393a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6501:x1875871102142336:12345-0@lo:503: Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970183.064053:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970183.064128:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257184dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142336:0@lo:503: 00000040:00080000:0.0:1788970183.065216:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788970183.065532:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788970183.065561:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970183.065581:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.065595:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970183.065658:0:6501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788970183.065773:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7eb0d2c000 10000000:01000000:1.0:1788970183.065778:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7eb0d2c000 10000000:01000000:1.0:1788970183.065783:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970183.065790:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eb0d2c000 from 1 10000000:01000000:1.0:1788970183.065793:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788970183.065838:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.065846:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.065858:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970183.065883:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b43b6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142464:0@lo:101: 00000100:00100000:1.0:1788970183.065964:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970183.066031:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650339af going to sleep for 11 seconds 00000100:00100000:3.0:1788970183.066130:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142464 00000100:00100000:3.0:1788970183.066140:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142464 00000100:00100000:3.0:1788970183.066194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970183.066203:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a8cf873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6501:x1875871102142464:12345-0@lo:101: 00010000:00010000:3.0:1788970183.066218:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970183.066236:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e41e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.066263:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.066274:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970183.066290:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003265f317, rc 0) 00000100:00100000:3.0:1788970183.066339:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a8cf873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102142464:12345-0@lo:101: Request processed in 137us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970183.066346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970183.066633:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b43b6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142464:0@lo:101: 00010000:00010000:1.0:1788970183.066651:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.066738:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970183.066824:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b43b6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142592:0@lo:501: 00000100:00100000:1.0:1788970183.066856:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970183.066918:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000650339af going to sleep for 11 seconds 00000100:00100000:3.0:1788970183.066955:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142592 00000100:00100000:3.0:1788970183.066960:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142592 00000100:00100000:3.0:1788970183.067024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970183.067032:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d135747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102142592:12345-0@lo:501: 00000100:00100000:3.0:1788970183.067221:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d135747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102142592:12345-0@lo:501: Request processed in 190us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970183.067228:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970183.067307:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b43b6e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142592:0@lo:501: 00000100:00100000:0.0:1788970183.067336:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000257184dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142720:0@lo:503: 00000100:00100000:0.0:1788970183.067603:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970183.067829:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142720 00000100:00100000:1.0:1788970183.067835:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142720 00000100:00100000:1.0:1788970183.067903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970183.067910:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000686149a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102142720:12345-0@lo:503: 00000100:00100000:1.0:1788970183.068006:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000686149a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102142720:12345-0@lo:503: Request processed in 97us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970183.068013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970183.068135:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6c1cd82 going to sleep for 11 seconds 00000100:00100000:1.0:1788970183.068153:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000257184dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102142720:0@lo:503: 00000100:00100000:2.0:1788970183.068860:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003337edbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6551:1875871102142848:0@lo:502: 00000100:00100000:2.0:1788970183.068919:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970183.068989:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c923f2d going to sleep for 11 seconds 00000100:00100000:3.0:1788970183.069024:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142848 00000100:00100000:3.0:1788970183.069031:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142848 00000100:00100000:3.0:1788970183.069106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788970183.069115:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df536649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6551:x1875871102142848:12345-0@lo:502: 00000100:00100000:3.0:1788970183.069234:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df536649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6551:x1875871102142848:12345-0@lo:502: Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970183.069242:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970183.069311:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003337edbe pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6551:1875871102142848:0@lo:502: 00000020:01000004:2.0:1788970183.069418:0:6551:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788970183.069439:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000011824dab) 00000020:00000080:2.0:1788970183.069461:0:6551:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788970183.069551:0:6551:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c164a55f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788970183.069555:0:6551:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c164a55f from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788970183.069558:0:6551:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c164a55f 4 00010000:00080000:2.0:1788970183.069590:0:6551:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000018deb501@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970183.071220:0:6551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788970183.071508:0:6551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788970183.071558:0:6551:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788970183.071574:0:6551:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3abfebe76c6e433 00000100:00080000:2.0:1788970183.071587:0:6551:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970183.071597:0:6551:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000018deb501 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970183.071643:0:6551:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003337edbe x1875871102142976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970183.071663:0:6551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788970183.074720:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6551:1875871102143104:0@lo:502: 00000100:00100000:3.0:1788970183.074841:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970183.074893:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 00000000808e0d67 going to sleep for 11 seconds 00000100:00100000:1.0:1788970183.075163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143104 00000100:00100000:1.0:1788970183.075175:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143104 00000100:00100000:1.0:1788970183.075243:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970183.075252:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002650052b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6551:x1875871102143104:12345-0@lo:502: 00000100:00100000:1.0:1788970183.075452:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002650052b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6551:x1875871102143104:12345-0@lo:502: Request processed in 201us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970183.075460:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970183.075608:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:6551:1875871102143104:0@lo:502: 00000040:00080000:2.0:1788970183.075646:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788970183.075883:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788970183.075906:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970183.075927:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970183.075939:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788970183.075990:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788970183.075993:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788970183.075995:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970183.075996:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970183.075998:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970183.075999:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970183.076000:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970183.076001:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788970183.076003:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970183.076004:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970183.076005:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970183.076007:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970183.076011:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788970183.076014:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970183.076015:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788970183.076016:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970183.076017:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970183.076018:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970183.076019:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970183.076020:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970183.076021:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788970183.076022:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970183.076022:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970183.076023:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970183.076024:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970183.076048:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788970183.076062:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102143232:0@lo:253: 00000100:00100000:1.0:1788970183.076113:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970183.076144:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052358a12 going to sleep for 11 seconds 00000100:00100000:3.0:1788970183.076263:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143232 00000100:00100000:3.0:1788970183.076271:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143232 00000100:00100000:3.0:1788970183.076313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788970183.076321:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa74598a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102143232:12345-0@lo:253: 20000000:01000000:3.0:1788970183.076345:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788970183.076368:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788970183.077876:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003337edbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102142976:0@lo:38: 00000100:00100000:0.0:1788970183.077972:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970183.080500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102142976 00000100:00100000:2.0:1788970183.080523:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102142976 00000100:00100000:2.0:1788970183.080608:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970183.080628:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008efd44b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102142976:12345-0@lo:38: 00000100:00100000:2.0:1788970183.080837:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008efd44b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102142976:12345-0@lo:38: Request processed in 209us (2864us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788970183.080845:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970183.080926:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970183.080938:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000018deb501 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970183.080942:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788970183.080946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003337edbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102142976:0@lo:38: 20000000:01000000:0.0:1788970183.086062:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788970183.086082:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788970183.086239:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970183.086244:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788970183.086272:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.086298:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.086307:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.086355:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.086371:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970183.086413:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102143360:0@lo:104: 00000100:00100000:0.0:1788970183.086499:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970183.086558:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc856dfa going to sleep for 11 seconds 00000100:00100000:0.0:1788970183.087181:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa74598a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6501:x1875871102143232:12345-0@lo:253: Request processed in 10859us (11066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970183.087196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788970183.087312:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:6501:1875871102143232:0@lo:253: 10000000:01000000:1.0:1788970183.087327:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788970183.087331:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970183.087333:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788970183.087335:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970183.087336:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970183.087337:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970183.087339:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970183.087340:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970183.087341:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788970183.087343:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970183.087344:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970183.087346:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970183.087347:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970183.087372:0:6501:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788970183.088873:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143360 00000100:00100000:2.0:1788970183.088890:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143360 00000100:00100000:2.0:1788970183.090850:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970183.090877:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007769c3e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102143360:12345-0@lo:104: 00010000:00010000:2.0:1788970183.090901:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970183.091040:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970183.091046:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007769c3e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102143360:12345-0@lo:104: Request processed in 183us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970183.091053:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970183.092892:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102143360:0@lo:104: 00010000:00010000:0.0:1788970183.092929:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.092957:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970183.092964:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.092971:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ecc93fa5 already unused, calling callback (000000005eca4434) 10000000:00010000:0.0:1788970183.092975:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.092984:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970183.092991:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970183.092996:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970183.093064:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093071:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970183.093097:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093103:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e409 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093144:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970183.093146:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970183.093147:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970183.093224:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102143488:0@lo:103: 00000100:00100000:0.0:1788970183.093295:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970183.093450:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143488 00000100:00100000:0.0:1788970183.093459:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143488 00010000:00010000:0.0:1788970183.093489:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970183.093528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970183.093537:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e0c3858 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3650:x1875871102143488:12345-0@lo:103: 00010000:00010000:0.0:1788970183.093551:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970183.093556:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093567:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093582:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000029f66050/0xc3abfebe76c6e409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e402 expref: 12 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093599:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093607:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788970183.093623:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007379733s 00010000:00010000:0.0:1788970183.093634:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093641:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093648:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093654:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093659:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e4cf067a already unused, calling callback (000000007bcbfd51) 00010000:00010000:0.0:1788970183.093663:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093670:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093683:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093693:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970183.093728:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e0c3858 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:3650:x1875871102143488:12345-0@lo:103: Request processed in 192us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970183.093736:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788970183.093775:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093784:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970183.093799:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4cf067a/0xc3abfebe76c6e43a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970183.093836:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102143488:0@lo:103: 00080000:10000000:1.0:1788970183.096010:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788970183.096244:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788970183.096537:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788970183.096757:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788970183.096970:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788970183.097138:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788970183.098375:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788970183.099832:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788970183.100112:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788970183.100275:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788970183.100589:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788970183.100844:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788970183.103473:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788970183.116074:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788970183.116825:0:6556:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788970183.116832:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788970183.116948:0:6557:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788970183.124294:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788970183.124506:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788970183.125121:0:6501:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788970183.125145:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788970183.125277:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970183.126603:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788970183.127443:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788970183.127494:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788970183.127848:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788970183.128235:0:6501:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788970183.129415:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788970183.129584:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788970183.129849:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788970183.130120:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788970183.130254:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788970183.130378:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788970183.130572:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788970183.130762:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788970183.131019:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788970183.131779:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000040:00080000:0.0:1788970183.131975:0:6557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788970183.132161:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788970183.132306:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788970183.132849:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788970183.136621:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788970183.136819:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788970183.136953:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788970183.137222:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788970183.137342:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788970183.137507:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788970183.137641:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788970183.137748:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788970183.137894:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788970183.138004:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788970183.138120:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788970183.138239:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788970183.138447:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788970183.138570:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:0.0:1788970183.141013:0:6557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788970183.141137:0:6557:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788970183.141142:0:6557:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788970183.145565:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788970183.145852:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788970183.146042:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788970183.146211:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788970183.146356:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788970183.146626:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788970183.154341:0:6501:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788970183.154420:0:6501:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa287c174b988 00100000:10000000:2.0:1788970183.154432:0:6501:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788970183.156128:0:6501:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788970183.156151:0:6501:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788970183.156173:0:6501:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788970183.156195:0:6501:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788970183.157145:0:6501:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970183.157357:0:6501:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788970183.709797:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970184.733429:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970185.757088:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970186.784191:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970187.765904:0:6802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788970187.804776:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970188.575075:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1788970188.576093:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788970188.576100:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788970188.576103:0:38:0:(import.c:65:import_set_state_nolock()) 0000000018deb501 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970188.576122:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000018deb501 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970188.576149:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf0114aa x1875871102143744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970188.576292:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf0114aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102143744:0@lo:38: 00000100:00100000:3.0:1788970188.576356:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970188.576483:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143744 00000100:00100000:0.0:1788970188.576492:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143744 00000100:00100000:0.0:1788970188.576532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970188.576539:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000888a3d2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102143744:12345-0@lo:38: 00010000:00080000:0.0:1788970188.576564:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1788970188.576599:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3abfebe76c6e441 00000004:00100000:0.0:1788970188.576639:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970188.576774:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000b8b8cf73 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970188.576838:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000888a3d2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875871102143744:12345-0@lo:38: Request processed in 297us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970188.576846:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788970188.576988:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf0114aa x1875871102143744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970188.577013:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788970188.577020:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788970188.577025:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788970188.577034:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000018deb501 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970188.577039:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf0114aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102143744:0@lo:38: 00000100:00100000:1.0:1788970188.580078:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102143616:0@lo:400: 00000100:00100000:1.0:1788970188.580154:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970188.583157:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143616 00000100:00100000:2.0:1788970188.583173:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143616 00000100:00100000:2.0:1788970188.583233:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788970188.583242:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000908a241e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:3652:x1875871102143616:12345-0@lo:400: 00000100:00100000:2.0:1788970188.583405:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000908a241e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:3652:x1875871102143616:12345-0@lo:400: Request processed in 164us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970188.583414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970188.584747:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102143616:0@lo:400: 00000020:00000004:2.0:1788970188.622378:0:6854:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970188.622891:0:6854:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970188.833683:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970189.857189:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970190.877490:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970191.225263:0:6956:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970191.225638:0:6956:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788970191.644496:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788970191.644504:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7eb0d2c000 from 3 10000000:01000000:3.0:1788970191.644509:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970191.644552:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970191.644565:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970191.644576:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970191.644599:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab374084 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102143872:0@lo:101: 00000100:00100000:3.0:1788970191.644659:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970191.644785:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b134af0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970191.648793:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102143872 00000100:00100000:0.0:1788970191.648808:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102143872 00000100:00100000:0.0:1788970191.648931:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970191.648939:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006828b1c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:6521:x1875871102143872:12345-0@lo:101: 00010000:00010000:0.0:1788970191.648955:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970191.648972:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e448 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970191.648998:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970191.649008:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970191.649017:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000998397be, rc 0) 00000100:00100000:0.0:1788970191.649088:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006828b1c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6521:x1875871102143872:12345-0@lo:101: Request processed in 150us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970191.649094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970191.649180:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab374084 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102143872:0@lo:101: 00010000:00010000:3.0:1788970191.649197:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970191.649205:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970191.649266:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab374084 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102144000:0@lo:256: 00000100:00100000:3.0:1788970191.649305:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970191.653930:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b134af0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970191.656073:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144000 00000100:00100000:0.0:1788970191.656092:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144000 00000100:00100000:2.0:1788970191.660394:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970191.660417:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a43e4a68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6521:x1875871102144000:12345-0@lo:256: 20000000:01000000:2.0:1788970191.660445:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970191.660468:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970191.660471:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788970191.662357:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a43e4a68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:6521:x1875871102144000:12345-0@lo:256: Request processed in 1947us (13047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970191.662372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970191.662774:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab374084 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102144000:0@lo:256: 10000000:01000000:3.0:1788970191.662826:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970191.662835:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970191.662858:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970191.902613:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970192.928072:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970193.692741:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970193.692817:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970193.692836:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd64a27e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102144256:0@lo:400: 00000100:00100000:1.0:1788970193.692907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970193.695507:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144256 00000100:00100000:2.0:1788970193.695520:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144256 00000100:00100000:2.0:1788970193.695598:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970193.695606:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000331f6008 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102144256:12345-0@lo:400: 00000100:00100000:2.0:1788970193.695731:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000331f6008 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102144256:12345-0@lo:400: Request processed in 116us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970193.695738:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788970193.695954:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fd64a27e x1875871102144256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970193.695970:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd64a27e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102144256:0@lo:400: 00000100:00100000:0.0:1788970193.697492:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044a81390 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102144128:0@lo:400: 00000100:00100000:0.0:1788970193.697555:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970193.697667:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144128 00000100:00100000:3.0:1788970193.697674:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144128 00000100:00100000:3.0:1788970193.697831:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970193.697839:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025eb3535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3651:x1875871102144128:12345-0@lo:400: 00000100:00100000:3.0:1788970193.697896:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025eb3535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3651:x1875871102144128:12345-0@lo:400: Request processed in 59us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970193.697903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970193.697967:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044a81390 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102144128:0@lo:400: 00010000:00010000:2.0:1788970193.950008:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970194.973324:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970196.004323:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970197.022000:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970198.045635:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970198.812555:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970198.812573:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097619374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102144512:0@lo:400: 00000100:00100000:0.0:1788970198.812573:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091c494b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102144384:0@lo:400: 00000100:00100000:3.0:1788970198.817699:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970198.820935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970198.821066:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144384 00000100:00100000:3.0:1788970198.821077:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144384 00000100:00100000:3.0:1788970198.821150:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970198.821158:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098652552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3649:x1875871102144384:12345-0@lo:400: 00000100:00100000:3.0:1788970198.821221:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098652552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3649:x1875871102144384:12345-0@lo:400: Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970198.821228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970198.821613:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091c494b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102144384:0@lo:400: 00000100:00100000:3.0:1788970198.821740:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144512 00000100:00100000:3.0:1788970198.821745:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144512 00000100:00100000:3.0:1788970198.821791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970198.821797:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6aa14ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102144512:12345-0@lo:400: 00000100:00100000:3.0:1788970198.821844:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6aa14ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102144512:12345-0@lo:400: Request processed in 48us (4149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970198.821851:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788970198.821986:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000097619374 x1875871102144512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970198.821998:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097619374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102144512:0@lo:400: 00010000:00010000:0.0:1788970199.072711:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970200.094629:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970200.869441:0:7454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788970200.869445:0:7454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788970200.869447:0:7454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788970200.869567:0:7454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000899b4789 00000020:01000004:2.0:1788970200.869582:0:7454:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788970200.869601:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788970200.869614:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000005c60b6bf) 00000020:00000080:2.0:1788970200.869628:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788970200.948913:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788970200.948986:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788970200.976666:0:7454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788970200.976877:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788970200.976886:0:7454:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788970200.976897:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6e45d 00000020:01000004:0.0:1788970200.976904:0:7454:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788970200.976925:0:7454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788970200.976928:0:7454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788970200.976933:0:7454:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788970200.976960:0:7454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788970200.976964:0:7454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788970201.001664:0:7454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788970201.001705:0:7454:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788970201.001710:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788970201.001712:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788970201.001714:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970201.001715:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970201.001716:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970201.001718:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970201.001719:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970201.001721:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788970201.001722:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788970201.001724:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970201.001725:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788970201.001728:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788970201.001732:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970201.001733:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788970201.001734:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970201.001735:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970201.001736:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970201.001737:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970201.001738:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970201.001739:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788970201.001740:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788970201.001741:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970201.001742:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788970201.001771:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788970201.001789:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044d90f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102144640:0@lo:253: 00000100:00100000:2.0:1788970201.001858:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.001897:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a201067 going to sleep for 11 seconds 00000100:00100000:3.0:1788970201.002070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144640 00000100:00100000:3.0:1788970201.002078:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144640 00000100:00100000:3.0:1788970201.002129:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970201.002137:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001346cae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102144640:12345-0@lo:253: 20000000:01000000:3.0:1788970201.002165:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788970201.002170:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788970201.002175:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788970201.002178:0:6517:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788970201.002208:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788970201.002411:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970201.002526:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788970201.002555:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788970201.002574:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788970201.002592:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788970201.002607:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788970201.002672:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788970201.002682:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788970201.002705:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788970201.002713:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788970201.002725:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788970201.002730:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788970201.002742:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788970201.002756:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788970201.002856:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788970201.002866:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:3.0:1788970201.002880:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788970201.002887:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788970201.002900:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788970201.002906:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:3.0:1788970201.002918:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788970201.002924:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788970201.002934:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788970201.002946:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788970201.002955:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788970201.003021:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788970201.003030:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788970201.003040:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788970201.003053:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788970201.003068:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788970201.003072:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788970201.003084:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788970201.003100:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788970201.003104:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788970201.003120:0:6517:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788970201.003126:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788970201.006868:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788970201.006993:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788970201.007030:0:6517:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.115@tcp for mdt 20000000:01000000:3.0:1788970201.007033:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:3.0:1788970201.007051:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788970201.007057:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788970201.007070:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788970201.007075:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:3.0:1788970201.007092:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788970201.007100:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788970201.007114:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788970201.007130:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788970201.007172:0:6517:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788970201.007180:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788970201.007792:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788970201.007922:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788970201.007936:0:6517:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.115@tcp for mdt 20000000:01000000:3.0:1788970201.007937:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:3.0:1788970201.007950:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788970201.007954:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788970201.007965:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788970201.007969:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:3.0:1788970201.007979:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788970201.007985:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788970201.007995:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788970201.008007:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788970201.008023:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788970201.008026:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788970201.008029:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788970201.008070:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788970201.008072:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788970201.008274:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788970201.008290:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788970201.008301:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788970201.008444:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788970201.008461:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788970201.008476:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788970201.008485:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788970201.008486:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788970201.008830:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788970201.008846:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788970201.008870:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788970201.008988:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788970201.009006:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788970201.009019:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788970201.009028:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788970201.009030:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788970201.009722:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788970201.009743:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788970201.009758:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788970201.009881:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788970201.009900:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788970201.009920:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788970201.009931:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788970201.009934:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788970201.009939:0:6517:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788970201.009944:0:6517:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788970201.010164:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788970201.010324:0:6517:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788970201.017881:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788970201.017936:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.017953:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.017960:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.017967:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.017973:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018018:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018033:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970201.018046:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875871102144768:0@lo:104: 00000100:00100000:0.0:1788970201.018106:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970201.018160:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018168:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970201.018192:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875871102144896:0@lo:104: 00000100:00100000:0.0:1788970201.018213:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.018236:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144768 00000100:00100000:0.0:1788970201.018244:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144768 00000100:00100000:0.0:1788970201.018279:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102144896 00000100:00100000:0.0:1788970201.018282:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102144896 00000100:00100000:0.0:1788970201.018293:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970201.018299:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b794f1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6517:x1875871102144768:12345-0@lo:104: 00010000:00010000:0.0:1788970201.018310:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018351:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970201.018355:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b794f1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6517:x1875871102144768:12345-0@lo:104: Request processed in 56us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.018360:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970201.018377:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970201.018415:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094df815e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6517:x1875871102144896:12345-0@lo:104: 00010000:00010000:0.0:1788970201.018422:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018452:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788970201.018456:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094df815e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6517:x1875871102144896:12345-0@lo:104: Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.018461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788970201.018476:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970201.018481:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018499:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aff17090 already unused, calling callback (000000005eca4434) 10000000:00010000:0.0:1788970201.018502:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018509:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970201.018515:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970201.018520:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970201.018546:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018553:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970201.018576:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018583:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000aff17090/0xc3abfebe76c6e41e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e425 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018595:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970201.018597:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018603:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000adffa60e already unused, calling callback (000000005eca4434) 10000000:00010000:0.0:1788970201.018605:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.018620:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970201.018626:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970201.018631:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788970201.018777:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cb89a4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102145024:0@lo:103: 00000100:00100000:2.0:1788970201.018812:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970201.020563:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970201.020619:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.020633:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970201.020657:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000946ab6f9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875871102145152:0@lo:104: 00000100:00100000:1.0:1788970201.020705:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970201.020730:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ae7d41f going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.020753:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875871102144768:0@lo:104: 00000100:00100000:1.0:1788970201.020762:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875871102144896:0@lo:104: 00000100:00100000:3.0:1788970201.022624:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145024 00000100:00100000:3.0:1788970201.022648:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145024 00010000:00010000:3.0:1788970201.022685:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 13 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.022722:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970201.022730:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fad6065b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:3652:x1875871102145024:12345-0@lo:103: 00010000:00010000:3.0:1788970201.022742:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970201.022747:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 13 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.022757:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 13 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.022773:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003265f317/0xc3abfebe76c6e425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e41e expref: 13 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.022804:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970201.022863:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fad6065b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3652:x1875871102145024:12345-0@lo:103: Request processed in 135us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970201.022870:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970201.023630:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cb89a4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102145024:0@lo:103: 00010000:00010000:0.0:1788970201.023805:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.023814:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970201.023845:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.023852:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000adffa60e/0xc3abfebe76c6e3ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e3b5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.023864:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.023866:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.023868:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970201.023884:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145152 00000100:00100000:0.0:1788970201.023888:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145152 00000100:00100000:3.0:1788970201.023910:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970201.023918:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970201.023920:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cb89a4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102145280:0@lo:103: 00000100:00100000:0.0:1788970201.023924:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008329fa25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6517:x1875871102145152:12345-0@lo:104: 00010000:00010000:0.0:1788970201.023932:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.023959:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970201.023973:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970201.023977:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008329fa25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6517:x1875871102145152:12345-0@lo:104: Request processed in 55us (3273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.023992:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970201.023994:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145280 00000100:00100000:3.0:1788970201.023997:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145280 00010000:00010000:0.0:1788970201.024009:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970201.024011:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.024013:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.024020:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005cf1664 already unused, calling callback (000000005eca4434) 10000000:00010000:0.0:1788970201.024023:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.024030:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788970201.024030:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.024035:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c94bd9d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:3650:x1875871102145280:12345-0@lo:103: 10000000:00010000:0.0:1788970201.024037:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.024042:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1788970201.024042:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970201.024045:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.024052:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.024063:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000679610fd/0xc3abfebe76c6e3b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e3ae expref: 12 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.024073:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970201.024106:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c94bd9d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:3650:x1875871102145280:12345-0@lo:103: Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970201.024112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970201.024439:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000946ab6f9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875871102145152:0@lo:104: 00010000:00010000:3.0:1788970201.024462:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.025904:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cb89a4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102145280:0@lo:103: 00010000:00010000:0.0:1788970201.027699:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.027714:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970201.027733:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.027739:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 0000000005cf1664/0xc3abfebe76c6e392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e399 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.027759:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.027762:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.027764:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970201.028089:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000878d2730 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102145408:0@lo:103: 00000100:00100000:3.0:1788970201.028149:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.029666:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145408 00000100:00100000:0.0:1788970201.029690:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145408 00010000:00010000:0.0:1788970201.029723:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 11 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970201.029765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970201.029773:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eeea1abd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:3650:x1875871102145408:12345-0@lo:103: 00010000:00010000:0.0:1788970201.029786:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970201.029791:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 11 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029803:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 11 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029818:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e392 expref: 11 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029832:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029840:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029856:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029863:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029868:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029874:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029888:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aaa8ca42 already unused, calling callback (000000007bcbfd51) 00010000:00010000:0.0:1788970201.029891:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029898:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029919:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.029929:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970201.029941:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.029948:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.029953:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aaa8ca42/0xc3abfebe76c6e464 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788970201.029968:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788970201.029984:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eeea1abd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:3650:x1875871102145408:12345-0@lo:103: Request processed in 212us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.029990:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970201.029997:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000878d2730 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102145408:0@lo:103: 00000100:00100000:1.0:1788970201.042981:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001346cae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:7454:x1875871102144640:12345-0@lo:253: Request processed in 40836us (41114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970201.042998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970201.043219:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044d90f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102144640:0@lo:253: 10000000:01000000:3.0:1788970201.043236:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788970201.043240:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970201.043242:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788970201.043244:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970201.043245:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788970201.043246:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970201.043247:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970201.043248:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970201.043250:0:7454:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788970201.043251:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970201.043253:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788970201.043273:0:7454:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000899b4789 from lustre-MDT0001 10000000:01000000:3.0:1788970201.043302:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788970201.043318:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788970201.043325:0:7454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7e848519c0 local copy 10000000:01000000:3.0:1788970201.043329:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788970201.043369:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.043482:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.043492:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.043521:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001600ea6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102145536:0@lo:101: 00000100:00100000:3.0:1788970201.043679:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.043724:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000146bdca1 going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.043773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145536 00000100:00100000:0.0:1788970201.043780:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145536 00000100:00100000:0.0:1788970201.043826:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788970201.043835:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c5be1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:7454:x1875871102145536:12345-0@lo:101: 00010000:00010000:0.0:1788970201.043846:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970201.043859:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e46b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.043896:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e46b expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.043906:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e46b expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.043915:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec582e58, rc 0) 00000100:00100000:0.0:1788970201.043967:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c5be1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:7454:x1875871102145536:12345-0@lo:101: Request processed in 133us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.043974:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970201.044059:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001600ea6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102145536:0@lo:101: 00010000:00010000:1.0:1788970201.044071:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.044087:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970201.044180:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e249408 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102145664:0@lo:501: 00000100:00100000:1.0:1788970201.044208:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970201.044234:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000005597442b going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.044277:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145664 00000100:00100000:0.0:1788970201.044282:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145664 00000100:00100000:0.0:1788970201.044313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970201.044320:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005920b1b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:7454:x1875871102145664:12345-0@lo:501: 00000100:00100000:0.0:1788970201.044377:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005920b1b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:7454:x1875871102145664:12345-0@lo:501: Request processed in 58us (169us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788970201.044406:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970201.044431:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e249408 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102145664:0@lo:501: 10000000:01000000:0.0:1788970201.044443:0:7454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788970201.044472:0:7454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788970201.044476:0:7454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.044482:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.044488:0:7454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.044503:0:7454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788970201.044725:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7ebb899800 10000000:01000000:0.0:1788970201.044731:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788970201.044735:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a7e848519c0 10000000:01000000:0.0:1788970201.044737:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788970201.044740:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a7e848519c0 from 1 10000000:01000000:0.0:1788970201.044749:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788970201.044770:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.044776:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.044783:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970201.044794:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060d16a62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102145792:0@lo:101: 00000100:00100000:0.0:1788970201.044820:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.045177:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000404baeba going to sleep for 11 seconds 00010000:00010000:0.0:1788970201.045191:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970201.045197:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.045204:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea389b23 already unused, calling callback (000000005eca4434) 10000000:00010000:0.0:1788970201.045207:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.045214:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970201.045222:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970201.045227:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970201.045245:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.045262:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970201.045286:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.045293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000ea389b23/0xc3abfebe76c6e46b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e472 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.045309:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.045311:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.045312:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970201.045328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145792 00000100:00100000:0.0:1788970201.045332:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145792 00000100:00100000:2.0:1788970201.045404:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102145920:0@lo:103: 00000100:00100000:2.0:1788970201.045435:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.045473:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102145920 00000100:00100000:2.0:1788970201.045477:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102145920 00000100:00100000:2.0:1788970201.045503:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970201.045522:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b43cd47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:3651:x1875871102145920:12345-0@lo:103: 00010000:00010000:2.0:1788970201.045540:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970201.045551:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e46b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.045565:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970201.045594:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b43cd47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:3651:x1875871102145920:12345-0@lo:103: Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.045599:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970201.045626:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102145920:0@lo:103: 00000100:00100000:1.0:1788970201.049134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788970201.049230:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032cd545e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:7454:x1875871102145792:12345-0@lo:101: 00010000:00010000:2.0:1788970201.049249:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970201.049268:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b8fbc0c/0xc3abfebe76c6e480 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e479 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.049295:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b8fbc0c/0xc3abfebe76c6e480 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e479 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.049323:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b8fbc0c/0xc3abfebe76c6e480 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e479 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.049331:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b8fbc0c, rc 0) 00000100:00100000:2.0:1788970201.049425:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032cd545e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:7454:x1875871102145792:12345-0@lo:101: Request processed in 280us (4604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.049433:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970201.049670:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060d16a62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102145792:0@lo:101: 00010000:00010000:1.0:1788970201.049687:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.049696:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970201.049717:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788970201.049767:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.049775:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000e4cf067a/0xc3abfebe76c6e479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970201.049786:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a7ebb899800 10000000:01000000:1.0:1788970201.049791:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788970201.049796:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a7ebb899800 from 1 10000000:01000000:1.0:1788970201.049798:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788970201.049821:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.049839:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.049848:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970201.049866:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146048:0@lo:101: 00000100:00100000:1.0:1788970201.049898:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970201.049928:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c4e7212 going to sleep for 11 seconds 00000100:00100000:3.0:1788970201.050931:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146048 00000100:00100000:3.0:1788970201.050940:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146048 00000100:00100000:3.0:1788970201.050978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970201.050985:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6345ec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:7454:x1875871102146048:12345-0@lo:101: 00010000:00010000:3.0:1788970201.050996:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970201.051006:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003265f317/0xc3abfebe76c6e48e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e487 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.051024:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003265f317/0xc3abfebe76c6e48e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e487 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.051033:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003265f317/0xc3abfebe76c6e48e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e487 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.051040:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003265f317, rc 0) 00000100:00100000:3.0:1788970201.051078:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6345ec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:7454:x1875871102146048:12345-0@lo:101: Request processed in 94us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970201.051093:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970201.052095:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146048:0@lo:101: 00010000:00010000:1.0:1788970201.052112:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.052122:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970201.052141:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788970201.059683:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.059703:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000e83b38d0/0xc3abfebe76c6e487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970201.059713:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788970201.059790:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970201.059800:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a7ebb899800 10000000:01000000:2.0:1788970201.059803:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788970201.059807:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788970201.059810:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788970201.059848:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.059856:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.059866:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.059890:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146176:0@lo:101: 00000100:00100000:2.0:1788970201.059960:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.060008:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044109e2a going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.060051:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146176 00000100:00100000:0.0:1788970201.060059:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146176 00000100:00100000:0.0:1788970201.060111:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970201.060119:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009532033e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:7454:x1875871102146176:12345-0@lo:101: 00010000:00010000:0.0:1788970201.060133:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970201.060145:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e49c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e495 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.060166:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.060176:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7d3a04c/0xc3abfebe76c6e49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.060183:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7d3a04c, rc 0) 00000100:00100000:0.0:1788970201.060226:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009532033e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146176:12345-0@lo:101: Request processed in 108us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.060249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970201.060325:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146176:0@lo:101: 00010000:00010000:2.0:1788970201.060337:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.060355:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.060474:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146304:0@lo:501: 00000100:00100000:2.0:1788970201.060498:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.060516:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044109e2a going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.060705:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146304 00000100:00100000:1.0:1788970201.060710:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146304 00000100:00100000:1.0:1788970201.060743:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970201.060750:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000348a868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146304:12345-0@lo:501: 00000100:00100000:1.0:1788970201.060862:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000348a868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146304:12345-0@lo:501: Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970201.060869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970201.061087:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146304:0@lo:501: 00000100:00100000:2.0:1788970201.061112:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146432:0@lo:503: 00000100:00100000:2.0:1788970201.061151:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.061178:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044109e2a going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.061216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146432 00000100:00100000:0.0:1788970201.061220:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146432 00000100:00100000:0.0:1788970201.061249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970201.061255:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc326154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146432:12345-0@lo:503: 00000100:00100000:0.0:1788970201.061328:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc326154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146432:12345-0@lo:503: Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.061334:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970201.061521:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146432:0@lo:503: 00000040:00080000:2.0:1788970201.061884:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970201.061954:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146560:0@lo:502: 00000100:00100000:2.0:1788970201.061990:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.063754:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044109e2a going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.065116:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146560 00000100:00100000:0.0:1788970201.065125:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146560 00000100:00100000:1.0:1788970201.069449:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788970201.069462:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf75484f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146560:12345-0@lo:502: 00000100:00100000:1.0:1788970201.070845:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf75484f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146560:12345-0@lo:502: Request processed in 1383us (8852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970201.070856:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970201.070956:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146560:0@lo:502: 00000040:00080000:3.0:1788970201.071205:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788970201.071235:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788970201.071248:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788970201.071260:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788970201.071273:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788970201.071285:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788970201.071298:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788970201.071312:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788970201.071325:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788970201.071338:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788970201.071352:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788970201.071366:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788970201.071407:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788970201.071424:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788970201.071437:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788970201.071450:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788970201.071463:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788970201.071475:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788970201.071487:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788970201.071500:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788970201.071512:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788970201.071526:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788970201.071548:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788970201.071581:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5a5b819 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146688:0@lo:502: 00000100:00100000:3.0:1788970201.071626:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.074853:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa0465d2 going to sleep for 11 seconds 00000100:00100000:2.0:1788970201.078819:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146688 00000100:00100000:2.0:1788970201.078837:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146688 00000100:00100000:2.0:1788970201.078902:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970201.078910:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006094e24e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146688:12345-0@lo:502: 00000100:00100000:2.0:1788970201.079083:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006094e24e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102146688:12345-0@lo:502: Request processed in 174us (7457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.079091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970201.079373:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5a5b819 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102146688:0@lo:502: 00000040:00080000:3.0:1788970201.079497:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788970201.079525:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788970201.080219:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970201.080229:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970201.080232:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788970201.080238:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788970201.080241:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970201.080263:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000bc53ae14) 00000020:00000080:3.0:1788970201.080282:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788970201.080288:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788970201.080374:0:7466:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970201.080405:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6e4aa 00000020:00000080:3.0:1788970201.080717:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788970201.080722:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970201.080726:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970201.080727:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788970201.080730:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970201.080733:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970201.080735:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788970201.080738:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970201.080745:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000257873f9) 00000020:00000080:3.0:1788970201.080756:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788970201.080759:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788970201.080761:0:7466:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788970201.080764:0:7466:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788970201.080770:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970201.080811:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000899b4789 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788970201.080821:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000002da7e07b) 00000020:00000080:3.0:1788970201.080829:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788970201.080902:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788970201.080909:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e4bf 00000020:00000080:3.0:1788970201.081000:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788970201.081012:0:7466:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788970201.081017:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc3abfebe76c6e4c6 00080000:01000000:3.0:1788970201.081022:0:7466:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788970201.081026:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6e4cd 00080000:10000000:3.0:1788970201.081425:0:7466:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788970201.081696:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788970201.125768:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970201.224931:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788970201.225186:0:7466:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788970201.235868:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788970201.236232:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788970201.252699:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788970201.252710:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970201.252716:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.252718:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788970201.252721:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970201.252727:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.252728:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788970201.252730:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788970201.252735:0:7466:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:1.0:1788970201.252760:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970201.252775:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000dc30a0c8) 00000020:00000080:1.0:1788970201.252796:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788970201.252801:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788970201.252879:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788970201.252885:0:7466:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788970201.252892:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6e4db 00010000:00080000:1.0:1788970201.252921:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006a4aedf5@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1788970201.258208:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788970201.266248:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970201.266262:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788970201.266303:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788970201.266335:0:7466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e4e2 00000100:00080000:1.0:1788970201.266344:0:7466:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970201.266355:0:7466:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006a4aedf5 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970201.266687:0:7466:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bd2cc03f x1875871102146816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970201.266740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102146816:0@lo:38: 00000100:00100000:3.0:1788970201.266809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788970201.266882:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788970201.266953:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970201.266957:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.266959:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788970201.266962:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788970201.266965:0:7466:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788970201.266966:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970201.266967:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970201.266969:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788970201.266972:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.266973:0:7466:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788970201.266976:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970201.266980:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.266981:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788970201.266985:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788970201.267126:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146816 00000100:00100000:0.0:1788970201.267134:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146816 00000100:00100000:0.0:1788970201.267162:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.267168:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5a5b819 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102146816:12345-0@lo:38: 00010000:00080000:0.0:1788970201.267202:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:0.0:1788970201.267232:0:6529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e4e9 00000004:00100000:0.0:1788970201.267244:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788970201.267250:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788970201.267426:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970201.267436:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102146944:0@lo:400: 00000100:00100000:2.0:1788970201.267521:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.267575:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102146944 00000100:00100000:2.0:1788970201.267580:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102146944 00000100:00100000:2.0:1788970201.267612:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970201.267618:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044d90f1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102146944:12345-0@lo:400: 00000100:00100000:2.0:1788970201.267679:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044d90f1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102146944:12345-0@lo:400: Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.267685:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788970201.267719:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d415694f x1875871102146944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970201.267732:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102146944:0@lo:400: 00000004:01000000:1.0:1788970201.267943:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788970201.267973:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970201.267978:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.267980:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788970201.267983:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970201.267986:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.267987:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788970201.267990:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788970201.267992:0:7466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788970201.268240:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970201.268245:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970201.268246:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788970201.268256:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1788970201.268625:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788970201.268660:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788970201.268679:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.268689:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000029f66050/0xc3abfebe76c6e495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970201.268696:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebb899800 from 1 10000000:01000000:2.0:1788970201.268699:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970201.268730:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.268736:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.268743:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.268765:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147072:0@lo:101: 00000100:00100000:2.0:1788970201.268798:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.268827:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b7342b5 going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.268882:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147072 00000100:00100000:0.0:1788970201.268886:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147072 00000100:00100000:0.0:1788970201.268919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970201.268924:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d3f5798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+12:7454:x1875871102147072:12345-0@lo:101: 00010000:00010000:0.0:1788970201.268938:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970201.268949:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e4f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.268966:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.268974:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.268981:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005cf1664, rc 0) 00000100:00100000:0.0:1788970201.269007:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d3f5798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:7454:x1875871102147072:12345-0@lo:101: Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.269029:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970201.269163:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147072:0@lo:101: 00010000:00010000:2.0:1788970201.269174:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.269181:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.269890:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147200:0@lo:256: 00000100:00100000:2.0:1788970201.269928:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.270130:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b7342b5 going to sleep for 11 seconds 00000100:00100000:2.0:1788970201.270725:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147200 00000100:00100000:2.0:1788970201.270732:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147200 00000100:00100000:2.0:1788970201.270803:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970201.270811:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c28ca9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:7454:x1875871102147200:12345-0@lo:256: 20000000:01000000:2.0:1788970201.270828:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788970201.273129:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788970201.273137:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788970201.273554:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c28ca9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:7454:x1875871102147200:12345-0@lo:256: Request processed in 2742us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.273566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788970201.276163:0:6529:0:(import.c:65:import_set_state_nolock()) 000000009d9e1c1c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970201.276257:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5a5b819 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102146816:12345-0@lo:38: Request processed in 9086us (9447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970201.276273:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.276362:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970201.276372:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788970201.276408:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788970201.276414:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788970201.276417:0:3648:0:(import.c:65:import_set_state_nolock()) 000000006a4aedf5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788970201.276431:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102146816:0@lo:38: 00000100:00100000:0.0:1788970201.276786:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000008439a11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102147328:0@lo:41: 00000100:00100000:0.0:1788970201.276822:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.276975:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147328 00000100:00100000:2.0:1788970201.276981:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147328 00000100:00100000:2.0:1788970201.277046:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970201.277052:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf0114aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875871102147328:12345-0@lo:41: 00000004:00000024:2.0:1788970201.277082:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788970201.277277:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d415694f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147200:0@lo:256: 10000000:01000000:1.0:1788970201.277823:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970201.277845:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.277856:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970201.277863:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebb899800 from 1 10000000:01000000:1.0:1788970201.277865:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970201.277890:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.277895:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970201.277902:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970201.277915:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044a81390 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147456:0@lo:101: 00000100:00100000:1.0:1788970201.277947:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970201.277965:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 000000005597442b going to sleep for 11 seconds 00000100:00100000:3.0:1788970201.278281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147456 00000100:00100000:3.0:1788970201.278287:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147456 00000100:00100000:3.0:1788970201.278325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970201.278332:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031e2041a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:7454:x1875871102147456:12345-0@lo:101: 00010000:00010000:3.0:1788970201.278341:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970201.278352:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e4fe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.278372:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.278398:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.278406:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031b77922, rc 0) 00000100:00100000:3.0:1788970201.278439:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031e2041a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:7454:x1875871102147456:12345-0@lo:101: Request processed in 108us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970201.278445:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970201.278489:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044a81390 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147456:0@lo:101: 00010000:00010000:3.0:1788970201.278511:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.278519:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.278606:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147584:0@lo:501: 00000100:00100000:3.0:1788970201.278629:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.278658:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.278803:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147584 00000100:00100000:1.0:1788970201.278808:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147584 00000100:00100000:1.0:1788970201.278839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970201.278845:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e68a6982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:7454:x1875871102147584:12345-0@lo:501: 00000100:00100000:1.0:1788970201.278921:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e68a6982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:7454:x1875871102147584:12345-0@lo:501: Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970201.278936:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788970201.279003:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147584:0@lo:501: 00000100:00100000:3.0:1788970201.279102:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147712:0@lo:503: 00000100:00100000:3.0:1788970201.279136:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.279161:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.279199:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147712 00000100:00100000:1.0:1788970201.279203:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147712 00000100:00100000:1.0:1788970201.279228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970201.279233:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072e03d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:7454:x1875871102147712:12345-0@lo:503: 00000040:00080000:1.0:1788970201.279259:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970201.279292:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072e03d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:7454:x1875871102147712:12345-0@lo:503: Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970201.279298:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970201.279367:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147712:0@lo:503: 00000040:00080000:3.0:1788970201.279797:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970201.279860:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788970201.279930:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970201.280913:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788970201.283429:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 00000100:00100000:2.0:1788970201.287351:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf0114aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875871102147328:12345-0@lo:41: Request processed in 4692us (4922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.287401:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1788970201.288993:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970201.289022:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.289035:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970201.289107:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788970201.289110:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7ebb899800 10000000:01000000:3.0:1788970201.289140:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7ebb899800 10000000:01000000:3.0:1788970201.289144:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970201.289150:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7ebb899800 from 1 10000000:01000000:3.0:1788970201.289154:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970201.289190:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.289198:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.289209:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.289231:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147840:0@lo:101: 00000100:00100000:3.0:1788970201.289296:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.289341:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.289486:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147840 00000100:00100000:0.0:1788970201.289494:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147840 00000100:00100000:0.0:1788970201.289559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970201.289567:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005704a977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:7454:x1875871102147840:12345-0@lo:101: 00010000:00010000:0.0:1788970201.289588:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970201.289601:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e50c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.289623:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.289644:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec582e58/0xc3abfebe76c6e513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970201.289651:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec582e58, rc 0) 00000100:00100000:0.0:1788970201.289690:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005704a977 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102147840:12345-0@lo:101: Request processed in 124us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.289696:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970201.289968:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147840:0@lo:101: 00010000:00010000:3.0:1788970201.289983:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.289990:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.290096:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147968:0@lo:501: 00000100:00100000:3.0:1788970201.290125:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.290188:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.290312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000008439a11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102147328:0@lo:41: 00000100:00100000:2.0:1788970201.294255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102147968 00000100:00100000:2.0:1788970201.294271:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102147968 00000100:00100000:2.0:1788970201.294329:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970201.294338:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000889f50c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102147968:12345-0@lo:501: 00000100:00100000:2.0:1788970201.294828:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000889f50c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102147968:12345-0@lo:501: Request processed in 491us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.294836:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970201.294920:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102147968:0@lo:501: 00000100:00100000:3.0:1788970201.294966:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148096:0@lo:503: 00000100:00100000:3.0:1788970201.295024:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.295060:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.295112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148096 00000100:00100000:0.0:1788970201.295117:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148096 00000100:00100000:0.0:1788970201.295150:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970201.295156:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f5e3779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148096:12345-0@lo:503: 00000100:00100000:0.0:1788970201.295256:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f5e3779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148096:12345-0@lo:503: Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.295262:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788970201.295336:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148096:0@lo:503: 00000040:00080000:3.0:1788970201.296859:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970201.296941:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148224:0@lo:502: 00000100:00100000:3.0:1788970201.296998:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.297043:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.297433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148224 00000100:00100000:1.0:1788970201.297441:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148224 00000100:00100000:1.0:1788970201.297512:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788970201.297520:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ef732a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148224:12345-0@lo:502: 00000100:00100000:1.0:1788970201.297650:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ef732a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148224:12345-0@lo:502: Request processed in 131us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970201.297657:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970201.299717:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148224:0@lo:502: 00000040:00080000:3.0:1788970201.300028:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788970201.300061:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788970201.300078:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788970201.300092:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788970201.300107:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788970201.300121:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788970201.300152:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788970201.300169:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788970201.300184:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788970201.300197:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788970201.300213:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788970201.300227:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788970201.300239:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788970201.300253:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788970201.300268:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788970201.300282:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788970201.300295:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788970201.300310:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788970201.300325:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788970201.300339:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788970201.300354:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788970201.300367:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788970201.300460:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788970201.300480:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788970201.300494:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788970201.300896:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788970201.300917:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788970201.300931:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788970201.300968:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148352:0@lo:502: 00000100:00100000:3.0:1788970201.302516:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.303104:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044317bbf going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.305685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148352 00000100:00100000:0.0:1788970201.305701:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148352 00000100:00100000:2.0:1788970201.309256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788970201.309273:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bcfa832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148352:12345-0@lo:502: 00000100:00100000:2.0:1788970201.309477:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bcfa832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148352:12345-0@lo:502: Request processed in 209us (6975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.309486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970201.311193:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148352:0@lo:502: 00000040:00080000:3.0:1788970201.311290:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788970201.311303:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788970201.319978:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788970201.319997:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000337bc3c2) 00000020:00000080:2.0:1788970201.320030:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788970201.320126:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000899b4789 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788970201.320131:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000899b4789 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788970201.320133:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000899b4789 3 00010000:00080000:2.0:1788970201.320163:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f35ee8fe@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970201.325087:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788970201.325366:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788970201.325434:0:7472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788970201.325456:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc3abfebe76c6e521 00000100:00080000:2.0:1788970201.325467:0:7472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970201.325482:0:7472:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000f35ee8fe using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970201.325529:0:7472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008135df0a x1875871102148480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970201.325564:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1788970201.325747:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1788970201.325859:0:7473:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788970201.326673:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102148480:0@lo:38: 00000100:00100000:0.0:1788970201.326744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.327223:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148480 00000100:00100000:2.0:1788970201.327231:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148480 00000100:00100000:2.0:1788970201.327264:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970201.327270:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000257184dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102148480:12345-0@lo:38: 00010000:00080000:2.0:1788970201.327295:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788970201.327322:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc3abfebe76c6e528 00000004:00100000:2.0:1788970201.327334:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970201.327359:0:6524:0:(import.c:65:import_set_state_nolock()) 000000007e6ed5ce : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970201.327430:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000257184dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875871102148480:12345-0@lo:38: Request processed in 158us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.327437:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788970201.327474:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008135df0a x1875871102148480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970201.327484:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970201.327491:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788970201.327499:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788970201.327503:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788970201.327505:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000f35ee8fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970201.327510:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102148480:0@lo:38: 00000020:01000000:2.0:1788970201.329834:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788970201.329897:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970201.329927:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.329941:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 000000007bc36a52/0xc3abfebe76c6e50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970201.329995:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970201.329998:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788970201.329999:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970201.330001:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970201.330002:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970201.330003:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970201.330005:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970201.330006:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788970201.330007:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788970201.330008:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970201.330010:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970201.330013:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788970201.330015:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970201.330017:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788970201.330018:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970201.330019:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970201.330020:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970201.330021:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970201.330022:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970201.330023:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788970201.330024:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788970201.330025:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970201.330026:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970201.330053:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788970201.330071:0:7454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148608:0@lo:253: 00000100:00100000:2.0:1788970201.330137:0:7454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.330185:0:7454:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044109e2a going to sleep for 11 seconds 00000100:00100000:1.0:1788970201.330264:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148608 00000100:00100000:1.0:1788970201.330273:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148608 00000100:00100000:1.0:1788970201.330323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970201.330331:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e708c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7454:x1875871102148608:12345-0@lo:253: 20000000:01000000:1.0:1788970201.330355:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788970201.330368:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788970201.353282:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788970201.353357:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970201.353376:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788970201.353719:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788970201.353724:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788970201.353744:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.353762:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.353770:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.353776:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.353813:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.353827:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 15 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.353854:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102148736:0@lo:104: 00000100:00100000:3.0:1788970201.353919:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970201.353969:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970201.353977:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 15 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.353985:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001600ea6f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102148864:0@lo:104: 00000100:00100000:3.0:1788970201.354007:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970201.354039:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 000000006640b851 going to sleep for 11 seconds 00000100:00100000:2.0:1788970201.354156:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148736 00000100:00100000:2.0:1788970201.354164:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148736 00000100:00100000:2.0:1788970201.354199:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148864 00000100:00100000:2.0:1788970201.354202:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148864 00000100:00100000:2.0:1788970201.354216:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970201.354224:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008439a11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6540:x1875871102148736:12345-0@lo:104: 00010000:00010000:2.0:1788970201.354234:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354288:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970201.354293:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008439a11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6540:x1875871102148736:12345-0@lo:104: Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.354300:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970201.354316:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970201.354321:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000097619374 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102148864:12345-0@lo:104: 00010000:00010000:2.0:1788970201.354327:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354358:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788970201.354362:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000097619374 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102148864:12345-0@lo:104: Request processed in 42us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.354367:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788970201.354406:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970201.354411:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354418:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000042b949df already unused, calling callback (000000005eca4434) 10000000:00010000:2.0:1788970201.354421:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354439:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970201.354444:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970201.354450:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970201.354475:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354482:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970201.354498:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354641:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e4f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e4f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354658:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970201.354661:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354666:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000872ffdf1 already unused, calling callback (000000005eca4434) 10000000:00010000:2.0:1788970201.354668:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354674:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970201.354680:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970201.354690:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970201.354705:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354711:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970201.354725:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354731:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000872ffdf1/0xc3abfebe76c6e448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e44f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354745:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970201.354747:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970201.354748:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970201.354754:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970201.354763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102148992:0@lo:103: 00000100:00100000:2.0:1788970201.354793:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.354831:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a51684c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102149120:0@lo:103: 00000100:00100000:2.0:1788970201.354858:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.354890:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102148992 00000100:00100000:2.0:1788970201.354894:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102148992 00010000:00010000:2.0:1788970201.354910:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 16 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.354928:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102149120 00000100:00100000:2.0:1788970201.354930:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102149120 00010000:00010000:2.0:1788970201.354940:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 17 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.354967:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970201.354973:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003337edbe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:3650:x1875871102148992:12345-0@lo:103: 00010000:00010000:2.0:1788970201.354983:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970201.354987:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 17 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.354996:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 17 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355250:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970201.355416:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e708c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:7454:x1875871102148608:12345-0@lo:253: Request processed in 25085us (25278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970201.355424:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788970201.355500:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003337edbe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3650:x1875871102148992:12345-0@lo:103: Request processed in 527us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.355518:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970201.355542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970201.355549:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de69c211 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3651:x1875871102149120:12345-0@lo:103: 00010000:00010000:2.0:1788970201.355558:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970201.355563:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 15 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355572:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 15 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355583:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355590:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970201.355614:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007379733s 00010000:00010000:2.0:1788970201.355618:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355625:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355630:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355647:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355653:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a53f09fe already unused, calling callback (000000007bcbfd51) 00010000:00010000:2.0:1788970201.355656:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355663:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355671:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.355680:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970201.355718:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de69c211 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3651:x1875871102149120:12345-0@lo:103: Request processed in 170us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.355725:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788970201.357143:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005cf1664/0xc3abfebe76c6e4f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e4f0 expref: 14 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.357178:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102148736:0@lo:104: 00010000:00010000:2.0:1788970201.357193:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000998397be/0xc3abfebe76c6e44f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e448 expref: 13 pid: 6517 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970201.357202:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001600ea6f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102148864:0@lo:104: 00010000:00010000:2.0:1788970201.357220:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.357229:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.357234:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970201.357240:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a53f09fe/0xc3abfebe76c6e52f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970201.357511:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a51684c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102149120:0@lo:103: 00000100:00100000:1.0:1788970201.360872:0:7454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:7454:1875871102148608:0@lo:253: 10000000:01000000:1.0:1788970201.360893:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788970201.360913:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970201.360915:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788970201.360917:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970201.360918:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970201.360919:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970201.360920:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970201.360922:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970201.360924:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970201.360925:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970201.360926:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970201.360928:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970201.360944:0:7454:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788970201.364154:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102148992:0@lo:103: 00080000:10000000:2.0:1788970201.373167:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788970201.373335:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788970201.374311:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788970201.378166:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788970201.382047:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788970201.382300:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788970201.383473:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788970201.383740:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788970201.383929:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788970201.384093:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788970201.384277:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788970201.384492:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788970201.386090:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788970201.386290:0:7477:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788970201.386294:0:7477:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788970201.386598:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788970201.386653:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091c494b8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875871102149248:0@lo:700: 00000100:00100000:3.0:1788970201.386710:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1788970201.386812:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788970201.386900:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102149248 00000100:00100000:0.0:1788970201.386908:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102149248 00000100:00100000:0.0:1788970201.386950:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.386957:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001600ea6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1875871102149248:12345-0@lo:700: 00000100:00100000:3.0:1788970201.387127:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a8e2a59 going to sleep for 11 seconds 00000100:00100000:2.0:1788970201.395217:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fad6065b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102149376:0@lo:1000: 00000100:00100000:2.0:1788970201.395287:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.395338:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ab07394 going to sleep for 11 seconds 00000040:01000000:3.0:1788970201.395806:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788970201.395920:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788970201.396339:0:7454:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788970201.396347:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788970201.396496:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970201.397471:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788970201.398012:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788970201.398041:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788970201.398199:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788970201.398423:0:7454:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1788970201.398888:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102149376 00000100:00100000:0.0:1788970201.398898:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102149376 00000100:00100000:0.0:1788970201.398941:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970201.398950:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b43cd47d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102149376:12345-0@lo:1000: 00000100:00100000:0.0:1788970201.399053:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b43cd47d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102149376:12345-0@lo:1000: Request processed in 104us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.399061:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970201.399253:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fad6065b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102149376:0@lo:1000: 00000040:01000000:2.0:1788970201.399286:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788970201.399322:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fad6065b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102149504:0@lo:700: 00000100:00100000:2.0:1788970201.399358:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.399420:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093b076fb going to sleep for 11 seconds 40000000:02000000:2.0:1788970201.400686:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1788970201.402627:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102149504 00000100:00100000:0.0:1788970201.402649:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102149504 00000100:00100000:0.0:1788970201.402702:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.402711:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003337edbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102149504:12345-0@lo:700: 00000100:00100000:0.0:1788970201.402803:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003337edbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102149504:12345-0@lo:700: Request processed in 93us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.402810:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.411167:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fad6065b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102149504:0@lo:700: 00000100:00100000:0.0:1788970201.411248:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875871102149632:0@lo:900: 00000100:00100000:0.0:1788970201.411306:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.411348:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102149632 00000100:00100000:0.0:1788970201.411355:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102149632 00000100:00100000:0.0:1788970201.411414:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.411423:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8e03efc pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1875871102149632:12345-0@lo:900: 00000100:00100000:0.0:1788970201.411469:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8e03efc pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1875871102149632:12345-0@lo:900: Request processed in 48us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.411492:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970201.411522:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff605686 going to sleep for 11 seconds 00010000:00080000:0.0:1788970201.411536:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004fe43298 x1875871102149632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970217 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970201.411548:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875871102149632:0@lo:900: 00000100:00100000:0.0:1788970201.411627:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102149760:0@lo:1000: 00000100:00100000:0.0:1788970201.411674:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.411698:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102149760 00000100:00100000:0.0:1788970201.411702:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102149760 00000100:00100000:0.0:1788970201.411731:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970201.411738:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e0c3858 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102149760:12345-0@lo:1000: 00000100:00100000:0.0:1788970201.411791:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e0c3858 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102149760:12345-0@lo:1000: Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970201.411799:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970201.411819:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000402eef10 going to sleep for 11 seconds 00000100:00100000:0.0:1788970201.411831:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102149760:0@lo:1000: 00000004:00080000:0.0:1788970201.411869:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ff605686 with version 0 00000020:00100000:0.0:1788970201.411882:0:7479:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788970201.411887:0:7479:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004fe43298 x1875871102150016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970201.411899:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102150016:0@lo:1000: 00000100:00100000:0.0:1788970201.411921:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.411939:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150016 00000100:00100000:0.0:1788970201.411942:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150016 00000100:00100000:0.0:1788970201.411958:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970201.411969:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060d16a62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102150016:12345-0@lo:1000: 00000100:00100000:0.0:1788970201.412240:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96792a going to sleep for 11 seconds 00100000:10000000:3.0:1788970201.412920:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788970201.413742:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788970201.413899:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788970201.415240:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788970201.415454:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788970201.417828:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788970201.417982:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788970201.418471:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788970201.418722:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788970201.418858:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788970201.418997:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:2.0:1788970201.419104:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001600ea6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1875871102149248:12345-0@lo:700: Request processed in 32144us (32390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.419122:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:0.0:1788970201.423283:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:3.0:1788970201.425246:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788970201.425504:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788970201.426509:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788970201.426677:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788970201.426831:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:2.0:1788970201.427277:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060d16a62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102150016:12345-0@lo:1000: Request processed in 15304us (15352us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788970201.427290:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788970201.427342:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788970201.427347:0:7479:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788970201.427361:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fe43298 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102150016:0@lo:1000: 00000100:00100000:2.0:1788970201.427462:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7dbf6e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102150144:0@lo:1000: 00000100:00100000:2.0:1788970201.427498:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970201.427529:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150144 00000100:00100000:2.0:1788970201.427535:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150144 00000100:00100000:2.0:1788970201.427570:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970201.427577:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003698e120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102150144:12345-0@lo:1000: 00000100:00100000:2.0:1788970201.427658:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003698e120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875871102150144:12345-0@lo:1000: Request processed in 81us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970201.427665:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970201.427695:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000877713ff going to sleep for 11 seconds 00000100:00100000:2.0:1788970201.427709:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7dbf6e3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875871102150144:0@lo:1000: 00000040:00080000:2.0:1788970201.427736:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788970201.427760:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002ab07394 with version 1 00010000:00080000:1.0:1788970201.429672:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000091c494b8 x1875871102149248/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788970217 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970201.429689:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091c494b8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875871102149248:0@lo:700: 40000000:02000000:1.0:1788970201.429703:0:7478:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1788970201.431151:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788970201.431401:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788970201.431552:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788970201.431722:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788970201.431855:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788970201.432000:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788970201.432171:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788970201.432319:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788970201.432506:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:2.0:1788970201.435698:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788970201.435790:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1788970201.437702:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788970201.438005:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000004:00080000:0.0:1788970201.438120:0:7469:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000cd8a7aa3 version 1 rpc_version 1 00000020:00100000:0.0:1788970201.438158:0:7469:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788970201.438168:0:7469:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009fb071e1 x1875871102150400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970201.438190:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1875871102150400:0@lo:1000: 00000100:00100000:0.0:1788970201.438256:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970201.438296:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028be1b53 going to sleep for 11 seconds 00100000:10000000:3.0:1788970201.438886:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000100:00100000:2.0:1788970201.439539:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150400 00000100:00100000:2.0:1788970201.439549:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150400 00000100:00100000:2.0:1788970201.439595:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970201.439604:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000878d2730 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875871102150400:12345-0@lo:1000: 00100000:10000000:3.0:1788970201.440129:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788970201.440322:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788970201.440486:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788970201.442282:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788970201.442958:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788970201.457063:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788970201.457255:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000878d2730 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875871102150400:12345-0@lo:1000: Request processed in 17650us (18997us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788970201.457267:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788970201.457359:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788970201.457364:0:7469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788970201.457408:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1875871102150400:0@lo:1000: 00000001:00080000:3.0:1788970201.461437:0:7454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788970201.461474:0:7454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa287c3343988 00100000:10000000:3.0:1788970201.461482:0:7454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:3.0:1788970201.467918:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:3.0:1788970201.469501:0:7454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788970201.469543:0:7454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788970201.469564:0:7454:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788970201.469585:0:7454:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788970201.471797:0:7454:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970201.471999:0:7454:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1788970201.480999:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788970201.486856:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788970201.486864:0:7478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788970202.142768:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970203.164482:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970204.190178:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970205.213028:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970206.029428:0:7724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788970206.236549:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970206.492655:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102150784:0@lo:400: 00000100:00100000:0.0:1788970206.492725:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970206.492784:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970206.492790:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102150656:0@lo:400: 00000100:00100000:1.0:1788970206.493164:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102150912:0@lo:400: 00000100:00100000:1.0:1788970206.493197:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970206.493227:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970206.493233:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cb89a4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102150528:0@lo:400: 00000100:00100000:1.0:1788970206.493259:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970206.493294:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150912 00000100:00100000:1.0:1788970206.493301:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150912 00000100:00100000:1.0:1788970206.493344:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970206.493365:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080303c83 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102150912:12345-0@lo:400: 00000100:00100000:1.0:1788970206.493436:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080303c83 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102150912:12345-0@lo:400: Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970206.493442:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788970206.493482:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009fb071e1 x1875871102150912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970206.493495:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fb071e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102150912:0@lo:400: 00000100:00100000:1.0:1788970206.493545:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150784 00000100:00100000:1.0:1788970206.493549:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150784 00000100:00100000:1.0:1788970206.493571:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970206.493576:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fe43298 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102150784:12345-0@lo:400: 00000100:00100000:1.0:1788970206.493625:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fe43298 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102150784:12345-0@lo:400: Request processed in 49us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970206.493631:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970206.493654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150528 00000100:00100000:1.0:1788970206.493657:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150528 00000100:00100000:1.0:1788970206.493678:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970206.493683:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5627841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:3651:x1875871102150528:12345-0@lo:400: 00000100:00100000:1.0:1788970206.493715:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5627841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:3651:x1875871102150528:12345-0@lo:400: Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970206.493720:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970206.493750:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cb89a4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102150528:0@lo:400: 00000100:00100000:0.0:1788970206.493891:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970206.493929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102150784:0@lo:400: 00000100:00100000:3.0:1788970206.494274:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970206.494294:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102151040:0@lo:41: 00000100:00100000:3.0:1788970206.494327:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970206.494414:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102150656 00000100:00100000:1.0:1788970206.494419:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102150656 00000100:00100000:1.0:1788970206.494456:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970206.494464:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cb89a4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102150656:12345-0@lo:400: 00000100:00100000:1.0:1788970206.494522:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cb89a4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102150656:12345-0@lo:400: Request processed in 59us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970206.494529:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970206.494557:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151040 00000100:00100000:1.0:1788970206.494561:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151040 00000100:00100000:1.0:1788970206.494581:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970206.494587:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c94bd9d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102151040:12345-0@lo:41: 00000004:00000024:1.0:1788970206.494624:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788970206.494660:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c94bd9d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102151040:12345-0@lo:41: Request processed in 74us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970206.494666:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788970206.495326:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dfd7b563 x1875871102150656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970206.495339:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102150656:0@lo:400: 00000100:00100000:3.0:1788970206.495428:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102151040:0@lo:41: 00000020:00000004:2.0:1788970206.976914:0:7776:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970206.977156:0:7776:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970207.260588:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970208.035799:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970208.035807:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebb899800 from 4 10000000:01000000:0.0:1788970208.035812:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970208.035856:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.035879:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.035890:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970208.035910:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151168:0@lo:101: 00000100:00100000:0.0:1788970208.035976:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970208.036157:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1bd06c8 going to sleep for 11 seconds 00000100:00100000:3.0:1788970208.043558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151168 00000100:00100000:3.0:1788970208.043574:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151168 00000100:00100000:3.0:1788970208.043740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788970208.043751:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057900144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:6521:x1875871102151168:12345-0@lo:101: 00010000:00010000:3.0:1788970208.043768:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970208.043786:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cbe14204/0xc3abfebe76c6e53d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.043812:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cbe14204/0xc3abfebe76c6e53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.043822:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cbe14204/0xc3abfebe76c6e53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.043829:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cbe14204, rc 0) 00000100:00100000:3.0:1788970208.043909:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057900144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:6521:x1875871102151168:12345-0@lo:101: Request processed in 160us (7933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970208.043916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970208.044006:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151168:0@lo:101: 00010000:00010000:0.0:1788970208.044024:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.044033:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970208.044101:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151296:0@lo:256: 00000100:00100000:0.0:1788970208.044139:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.063601:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151296 00000100:00100000:1.0:1788970208.063615:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151296 00000100:00100000:1.0:1788970208.063732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788970208.063742:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d567f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:6521:x1875871102151296:12345-0@lo:256: 20000000:01000000:1.0:1788970208.063772:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788970208.063794:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788970208.063797:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788970208.063902:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d567f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:6521:x1875871102151296:12345-0@lo:256: Request processed in 162us (19762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.063909:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788970208.064171:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1bd06c8 going to sleep for 11 seconds 00000100:00100000:2.0:1788970208.064193:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfd7b563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151296:0@lo:256: 10000000:01000000:2.0:1788970208.064243:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970208.064250:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.064260:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000aaa8ca42/0xc3abfebe76c6e536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970208.064270:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788970208.064272:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eb0d2c000 from 21 10000000:01000000:2.0:1788970208.064274:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970208.064300:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.064310:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.064316:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970208.064327:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151424:0@lo:101: 00000100:00100000:2.0:1788970208.064350:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.064374:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d42c60ca going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.064445:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151424 00000100:00100000:1.0:1788970208.064449:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151424 00000100:00100000:1.0:1788970208.064463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788970208.064466:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000402842db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:6521:x1875871102151424:12345-0@lo:101: 00010000:00010000:1.0:1788970208.064472:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970208.064490:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aff17090/0xc3abfebe76c6e54b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e544 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970208.064512:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aff17090/0xc3abfebe76c6e54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970208.064518:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aff17090/0xc3abfebe76c6e54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970208.064524:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aff17090, rc 0) 00000100:00100000:1.0:1788970208.064550:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000402842db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102151424:12345-0@lo:101: Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.064554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970208.064688:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151424:0@lo:101: 00010000:00010000:2.0:1788970208.064699:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.064707:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970208.064760:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151552:0@lo:501: 00000100:00100000:2.0:1788970208.064784:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.064808:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d42c60ca going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.064919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151552 00000100:00100000:1.0:1788970208.064923:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151552 00000100:00100000:1.0:1788970208.064940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970208.064945:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d32bfe41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102151552:12345-0@lo:501: 00000100:00100000:1.0:1788970208.065057:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d32bfe41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102151552:12345-0@lo:501: Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.065063:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788970208.065134:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151552:0@lo:501: 00000100:00100000:2.0:1788970208.065160:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151680:0@lo:503: 00000100:00100000:2.0:1788970208.065199:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.065221:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d42c60ca going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.065275:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151680 00000100:00100000:1.0:1788970208.065280:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151680 00000100:00100000:1.0:1788970208.065297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970208.065303:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7afd244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102151680:12345-0@lo:503: 00000100:00100000:1.0:1788970208.065397:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7afd244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102151680:12345-0@lo:503: Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.065404:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788970208.065480:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102151680:0@lo:503: 00000100:00100000:1.0:1788970208.065938:0:7828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7828:1875871102151808:0@lo:502: 00000100:00100000:1.0:1788970208.065972:0:7828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.066006:0:7828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000036ae403 going to sleep for 11 seconds 00000100:00100000:2.0:1788970208.066053:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151808 00000100:00100000:2.0:1788970208.066062:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151808 00000100:00100000:2.0:1788970208.066080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970208.066084:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073f101dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7828:x1875871102151808:12345-0@lo:502: 00000100:00100000:2.0:1788970208.066197:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073f101dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7828:x1875871102151808:12345-0@lo:502: Request processed in 112us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970208.066203:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970208.066336:0:7828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7828:1875871102151808:0@lo:502: 00000100:00100000:2.0:1788970208.066561:0:7828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7828:1875871102151936:0@lo:502: 00000100:00100000:2.0:1788970208.066606:0:7828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.066668:0:7828:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b4ea7a5 going to sleep for 11 seconds 00000100:00100000:0.0:1788970208.066793:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102151936 00000100:00100000:0.0:1788970208.066798:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102151936 00000100:00100000:1.0:1788970208.066842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970208.066850:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5025407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7828:x1875871102151936:12345-0@lo:502: 00000100:00100000:1.0:1788970208.066926:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5025407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:7828:x1875871102151936:12345-0@lo:502: Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.066932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788970208.067008:0:7828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7828:1875871102151936:0@lo:502: 00000040:00080000:2.0:1788970208.067027:0:7828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788970208.067184:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788970208.067204:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970208.067211:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.067220:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000042b949df/0xc3abfebe76c6e544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970208.067238:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788970208.067240:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7eb0d2c000 from 4 10000000:01000000:3.0:1788970208.067244:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970208.067266:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.067272:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.067280:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970208.067292:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152064:0@lo:101: 00000100:00100000:3.0:1788970208.067318:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.067342:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b15a57f9 going to sleep for 11 seconds 00000100:00100000:2.0:1788970208.067424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152064 00000100:00100000:2.0:1788970208.067428:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152064 00000100:00100000:2.0:1788970208.067459:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788970208.067464:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f6d0a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102152064:12345-0@lo:101: 00010000:00010000:2.0:1788970208.067472:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970208.068075:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b0d7979/0xc3abfebe76c6e559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.068103:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b0d7979/0xc3abfebe76c6e559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.068113:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b0d7979/0xc3abfebe76c6e559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.068122:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b0d7979, rc 0) 00000100:00100000:2.0:1788970208.068170:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f6d0a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102152064:12345-0@lo:101: Request processed in 706us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970208.068187:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788970208.068822:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152064:0@lo:101: 00010000:00010000:3.0:1788970208.068837:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.068846:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970208.068897:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152192:0@lo:256: 00000100:00100000:3.0:1788970208.068932:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.068968:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b15a57f9 going to sleep for 11 seconds 00000100:00100000:2.0:1788970208.069028:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152192 00000100:00100000:2.0:1788970208.069033:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152192 00000100:00100000:2.0:1788970208.069071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970208.069078:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3a4a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102152192:12345-0@lo:256: 20000000:01000000:2.0:1788970208.069091:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970208.069106:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970208.069109:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788970208.069179:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3a4a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102152192:12345-0@lo:256: Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970208.069186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788970208.069304:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152192:0@lo:256: 10000000:01000000:3.0:1788970208.069343:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970208.069352:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.069360:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 0000000075805a8e/0xc3abfebe76c6e552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970208.069369:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788970208.069371:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788970208.069373:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788970208.069432:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.069440:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.069448:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970208.069459:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152320:0@lo:101: 00000100:00100000:3.0:1788970208.069773:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.069801:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b15a57f9 going to sleep for 11 seconds 00000100:00100000:3.0:1788970208.069814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152320 00000100:00100000:3.0:1788970208.069818:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152320 00000100:00100000:3.0:1788970208.069838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970208.069842:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c65c2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102152320:12345-0@lo:101: 00010000:00010000:3.0:1788970208.069849:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970208.069858:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000872ffdf1/0xc3abfebe76c6e567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.069872:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000872ffdf1/0xc3abfebe76c6e567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.069886:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000872ffdf1/0xc3abfebe76c6e567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.069893:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000872ffdf1, rc 0) 00000100:00100000:3.0:1788970208.069974:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c65c2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102152320:12345-0@lo:101: Request processed in 131us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970208.069980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970208.071182:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152320:0@lo:101: 00010000:00010000:1.0:1788970208.071200:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970208.071209:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970208.071851:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152448:0@lo:501: 00000100:00100000:0.0:1788970208.071896:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970208.071966:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a8e2a59 going to sleep for 11 seconds 00000100:00100000:2.0:1788970208.072012:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152448 00000100:00100000:2.0:1788970208.072018:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152448 00000100:00100000:2.0:1788970208.072092:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970208.072100:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095ed5adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102152448:12345-0@lo:501: 00000100:00100000:2.0:1788970208.072232:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095ed5adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102152448:12345-0@lo:501: Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970208.072238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788970208.072308:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152448:0@lo:501: 00000100:00100000:3.0:1788970208.072336:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152576:0@lo:503: 00000100:00100000:3.0:1788970208.072377:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.072894:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b15a57f9 going to sleep for 11 seconds 00000100:00100000:0.0:1788970208.072971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152576 00000100:00100000:0.0:1788970208.072976:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152576 00000100:00100000:0.0:1788970208.073001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788970208.073008:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084a03c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102152576:12345-0@lo:503: 00000100:00100000:0.0:1788970208.073110:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084a03c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102152576:12345-0@lo:503: Request processed in 102us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970208.073117:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788970208.073196:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102152576:0@lo:503: 00000100:00100000:3.0:1788970208.073804:0:7829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7829:1875871102152704:0@lo:502: 00000100:00100000:3.0:1788970208.073844:0:7829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.073874:0:7829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b17a827d going to sleep for 11 seconds 00000100:00100000:0.0:1788970208.073928:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152704 00000100:00100000:0.0:1788970208.073933:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152704 00000100:00100000:0.0:1788970208.073953:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970208.073958:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f5b3e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:7829:x1875871102152704:12345-0@lo:502: 00000100:00100000:0.0:1788970208.074041:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f5b3e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:7829:x1875871102152704:12345-0@lo:502: Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970208.074047:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788970208.074414:0:7829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7829:1875871102152704:0@lo:502: 00000020:01000000:3.0:1788970208.074436:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970208.074446:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970208.074448:0:7829:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788970208.074453:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788970208.074457:0:7829:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:3.0:1788970208.074478:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970208.074608:0:7829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000659d99d6) 00000020:00000080:3.0:1788970208.074628:0:7829:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788970208.074635:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788970208.074847:0:7829:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788970208.074853:0:7829:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788970208.074867:0:7829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e575 00010000:00080000:3.0:1788970208.074893:0:7829:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fdf44358@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970208.078175:0:7829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788970208.079930:0:7829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970208.079942:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788970208.079977:0:7829:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788970208.079999:0:7829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e57c 00000100:00080000:2.0:1788970208.080009:0:7829:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970208.080019:0:7829:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000fdf44358 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970208.080053:0:7829:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db2db436 x1875871102152832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970208.080131:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102152832:0@lo:38: 00000100:00100000:0.0:1788970208.080196:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.080284:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152832 00000100:00100000:1.0:1788970208.080292:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152832 00000100:00100000:1.0:1788970208.080334:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970208.080340:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009fb071e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102152832:12345-0@lo:38: 00010000:00080000:1.0:1788970208.080361:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1788970208.080424:0:6529:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e583 00000004:00100000:1.0:1788970208.080437:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788970208.080442:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788970208.080964:0:7829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788970208.081051:0:7829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788970208.081717:0:7832:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000eeea1abd x1875871102152960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970208.081729:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068da055c going to sleep for 0 seconds 00000020:01000000:2.0:1788970208.082055:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970208.082061:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970208.082063:0:7829:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788970208.082067:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970208.082071:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970208.082073:0:7829:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970208.082076:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970208.082078:0:7829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788970208.082099:0:7829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7829:1875871102153088:0@lo:502: 00000100:00100000:2.0:1788970208.082158:0:7829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.082186:0:7829:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064b28999 going to sleep for 11 seconds 00000100:00100000:0.0:1788970208.082367:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153088 00000100:00100000:0.0:1788970208.082410:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153088 00000100:00100000:0.0:1788970208.082450:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970208.082458:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093aedeab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:7829:x1875871102153088:12345-0@lo:502: 00000100:00100000:0.0:1788970208.082814:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093aedeab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:7829:x1875871102153088:12345-0@lo:502: Request processed in 356us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970208.082821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788970208.082924:0:7829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:7829:1875871102153088:0@lo:502: 00000020:01000000:3.0:1788970208.082949:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970208.082954:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970208.082956:0:7829:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788970208.082960:0:7829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788970208.083407:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788970208.083435:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788970208.083445:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.083457:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000a53f09fe/0xc3abfebe76c6e560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970208.083479:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788970208.083678:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7e848519c0 from 1 10000000:01000000:0.0:1788970208.083683:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788970208.084038:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.084047:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.084056:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970208.084073:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102153216:0@lo:101: 00000100:00100000:0.0:1788970208.084112:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970208.084144:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1bd06c8 going to sleep for 11 seconds 00000100:00100000:3.0:1788970208.084897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153216 00000100:00100000:3.0:1788970208.084906:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153216 00000100:00100000:3.0:1788970208.085119:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788970208.085127:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e318154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102153216:12345-0@lo:101: 00010000:00010000:3.0:1788970208.085140:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970208.085152:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea389b23/0xc3abfebe76c6e591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e58a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.085175:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea389b23/0xc3abfebe76c6e591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.085185:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea389b23/0xc3abfebe76c6e591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970208.085192:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea389b23, rc 0) 00000100:00100000:3.0:1788970208.085239:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e318154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102153216:12345-0@lo:101: Request processed in 113us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970208.085258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970208.085349:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102153216:0@lo:101: 00010000:00010000:0.0:1788970208.085363:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970208.085371:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970208.085457:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102153344:0@lo:501: 00000100:00100000:0.0:1788970208.085500:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.088013:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102153600:0@lo:400: 00000100:00100000:1.0:1788970208.088080:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.088126:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970208.088132:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102153472:0@lo:400: 00000100:00100000:1.0:1788970208.088174:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.088208:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788970208.088216:0:6530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788970208.088232:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153472 00000100:00100000:1.0:1788970208.088240:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153472 00000100:00100000:1.0:1788970208.088285:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970208.088293:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd64a27e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102153472:12345-0@lo:400: 00000100:00100000:1.0:1788970208.088337:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd64a27e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102153472:12345-0@lo:400: Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.088344:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788970208.088396:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000048577114 x1875871102153472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970208.088409:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102153472:0@lo:400: 00000100:00100000:0.0:1788970208.089362:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1bd06c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788970208.090011:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153600 00000100:00100000:0.0:1788970208.090019:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153600 00000100:00100000:0.0:1788970208.090151:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970208.090163:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b43b6e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102153600:12345-0@lo:400: 00000100:00100000:0.0:1788970208.090251:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b43b6e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102153600:12345-0@lo:400: Request processed in 89us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970208.090257:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970208.090801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153344 00000100:00100000:2.0:1788970208.090807:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153344 00000100:00100000:2.0:1788970208.090823:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970208.090837:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007503674c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102153728:0@lo:400: 00000100:00100000:2.0:1788970208.090877:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.091202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788970208.091210:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053792e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102153344:12345-0@lo:501: 00000100:00100000:2.0:1788970208.092021:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053792e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102153344:12345-0@lo:501: Request processed in 811us (6520us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970208.092031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788970208.092072:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102153344:0@lo:501: 10000000:01000000:2.0:1788970208.092113:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788970208.092120:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970208.092146:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: 00000000679610fd/0xc3abfebe76c6e58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970208.093077:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153728 00000100:00100000:0.0:1788970208.093085:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153728 00000100:00100000:0.0:1788970208.093136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970208.093143:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a51684c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102153728:12345-0@lo:400: 00000100:00100000:0.0:1788970208.093197:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a51684c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102153728:12345-0@lo:400: Request processed in 55us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970208.093203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970208.093612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be768729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102153600:0@lo:400: 00010000:00080000:2.0:1788970208.093792:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007503674c x1875871102153728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970208.093804:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007503674c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102153728:0@lo:400: 00000100:00080000:0.0:1788970208.099630:0:6529:0:(import.c:65:import_set_state_nolock()) 00000000eb431ba1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970208.099847:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009fb071e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102152832:12345-0@lo:38: Request processed in 19505us (19650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970208.099859:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970208.100625:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970208.100637:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788970208.100646:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788970208.100651:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788970208.100653:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000fdf44358 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788970208.100675:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000068da055c): req@00000000eeea1abd x1875871102152960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970208.100692:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db2db436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102152832:0@lo:38: 00000100:00100000:2.0:1788970208.100759:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab374084 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102153856:0@lo:41: 00000100:00100000:2.0:1788970208.100796:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.100851:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153856 00000100:00100000:3.0:1788970208.100859:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153856 00000100:00100000:2.0:1788970208.100867:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.100888:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068da055c going to sleep for 11 seconds 00000100:00100000:3.0:1788970208.100897:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102152960 00000100:00100000:3.0:1788970208.100901:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102152960 00000100:00100000:3.0:1788970208.100915:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970208.100922:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db2db436 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102153856:12345-0@lo:41: 00000004:00000024:3.0:1788970208.100948:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788970208.100992:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db2db436 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102153856:12345-0@lo:41: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970208.100999:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970208.101012:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970208.101017:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d415694f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102152960:12345-0@lo:1000: 00000100:00100000:3.0:1788970208.101067:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d415694f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102152960:12345-0@lo:1000: Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970208.101073:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970208.101366:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab374084 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102153856:0@lo:41: 00000100:00100000:2.0:1788970208.101413:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeea1abd pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102152960:0@lo:1000: 00000040:01000000:2.0:1788970208.101441:0:7832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788970208.101472:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102153984:0@lo:1000: 00000100:00100000:2.0:1788970208.101643:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.101694:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069952034 going to sleep for 11 seconds 00000100:00100000:3.0:1788970208.101763:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102153984 00000100:00100000:3.0:1788970208.101769:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102153984 00000100:00100000:3.0:1788970208.101790:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970208.101795:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8dec3da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102153984:12345-0@lo:1000: 00000100:00100000:3.0:1788970208.101898:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8dec3da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102153984:12345-0@lo:1000: Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970208.101904:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970208.101965:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008135df0a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102153984:0@lo:1000: 00000100:00100000:2.0:1788970208.102006:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000222f5772 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154112:0@lo:700: 00000100:00100000:2.0:1788970208.102030:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970208.102054:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd6244f0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.102173:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102154112 00000100:00100000:1.0:1788970208.102178:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102154112 00000100:00100000:1.0:1788970208.102210:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970208.102217:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008135df0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102154112:12345-0@lo:700: 00000100:00100000:1.0:1788970208.102277:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008135df0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102154112:12345-0@lo:700: Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.102283:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970208.102349:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000222f5772 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154112:0@lo:700: 00000100:00100000:3.0:1788970208.102557:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154240:0@lo:1000: 00000100:00100000:3.0:1788970208.102583:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.102617:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 000000003726c639 going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.102832:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102154240 00000100:00100000:1.0:1788970208.102837:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102154240 00000100:00100000:1.0:1788970208.102858:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970208.102864:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091c494b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102154240:12345-0@lo:1000: 00000100:00100000:1.0:1788970208.102928:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091c494b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102154240:12345-0@lo:1000: Request processed in 64us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.102934:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970208.103004:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154240:0@lo:1000: 00000004:00080000:3.0:1788970208.103041:0:7832:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b15a57f9 with version 0 00000020:00100000:3.0:1788970208.103055:0:7832:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788970208.103060:0:7832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000afe3aef8 x1875871102154496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970208.103073:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154496:0@lo:1000: 00000100:00100000:3.0:1788970208.103095:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.103118:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c51e38a5 going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.103557:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102154496 00000100:00100000:1.0:1788970208.103562:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102154496 00000100:00100000:1.0:1788970208.103593:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970208.103600:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eeea1abd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7832:x1875871102154496:12345-0@lo:1000: 00000001:00080000:2.0:1788970208.115166:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788970208.115181:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788970208.115346:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eeea1abd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7832:x1875871102154496:12345-0@lo:1000: Request processed in 11744us (12247us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788970208.115359:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788970208.115610:0:7832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788970208.115616:0:7832:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788970208.115631:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154496:0@lo:1000: 00000100:00100000:3.0:1788970208.115827:0:7832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154624:0@lo:1000: 00000100:00100000:3.0:1788970208.115862:0:7832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970208.115881:0:7832:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a5d12aa going to sleep for 11 seconds 00000100:00100000:1.0:1788970208.116720:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102154624 00000100:00100000:1.0:1788970208.116729:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102154624 00000100:00100000:1.0:1788970208.116779:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970208.116786:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab374084 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7832:x1875871102154624:12345-0@lo:1000: 00000100:00100000:1.0:1788970208.116865:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab374084 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7832:x1875871102154624:12345-0@lo:1000: Request processed in 80us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970208.116872:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970208.117634:0:7832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7832:1875871102154624:0@lo:1000: 00000040:00080000:3.0:1788970208.117658:0:7832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788970208.117709:0:7832:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b15a57f9 with version 1 00000040:00080000:3.0:1788970208.119751:0:7832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788970208.119835:0:7832:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788970208.119840:0:7832:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:1.0:1788970208.121541:0:7830:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000000da22639 version 1 rpc_version 1 00000020:00100000:1.0:1788970208.121597:0:7830:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788970208.121608:0:7830:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000048577114 x1875871102154880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970208.121632:0:7830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7830:1875871102154880:0@lo:1000: 00000100:00100000:1.0:1788970208.121723:0:7830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970208.121769:0:7830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad5b17e6 going to sleep for 11 seconds 00000100:00100000:3.0:1788970208.124652:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102154880 00000100:00100000:3.0:1788970208.124677:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102154880 00000100:00100000:3.0:1788970208.125178:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788970208.125188:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000335b9d12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7830:x1875871102154880:12345-0@lo:1000: 00000001:00080000:0.0:1788970208.135977:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788970208.136604:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000335b9d12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7830:x1875871102154880:12345-0@lo:1000: Request processed in 11414us (14878us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788970208.136631:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788970208.136764:0:7830:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788970208.136769:0:7830:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788970208.136786:0:7830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7830:1875871102154880:0@lo:1000: 00010000:00010000:2.0:1788970208.284920:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970209.309477:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970210.095885:0:7883:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970210.096103:0:7883:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970210.332696:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970211.357687:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788970211.380745:0:7931:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccc2f4060 20000000:00000080:0.0:1788970211.380761:0:7931:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7eb5746c00 uarg=0000000000000000 20000000:01000000:0.0:1788970211.380798:0:7931:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788970211.380805:0:7931:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788970211.380809:0:7931:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788970211.380882:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788970211.380893:0:7931:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788970211.386188:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970211.386483:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788970211.386527:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788970211.386546:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788970211.389861:0:7931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788970211.395372:0:7931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970211.395423:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970211.395430:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970211.395436:0:7931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970211.395480:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970211.395496:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 17 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970211.395509:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fad6065b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875871102155008:0@lo:104: 00000100:00100000:2.0:1788970211.395600:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970211.395681:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970211.395689:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 17 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970211.395698:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049d371e0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875871102155136:0@lo:104: 00000100:00100000:2.0:1788970211.395720:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071c8875e going to sleep for 11 seconds 00000100:00100000:1.0:1788970211.395876:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788970211.395897:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970211.395933:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155008 00000100:00100000:1.0:1788970211.395944:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155008 00000100:00100000:1.0:1788970211.395977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155136 00000100:00100000:1.0:1788970211.395980:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155136 00000100:00100000:1.0:1788970211.396005:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970211.396012:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004c4b192 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:7931:x1875871102155008:12345-0@lo:104: 00010000:00010000:1.0:1788970211.396023:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396085:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970211.396091:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004c4b192 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:7931:x1875871102155008:12345-0@lo:104: Request processed in 79us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970211.396098:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970211.396123:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fad6065b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875871102155008:0@lo:104: 00000100:00100000:1.0:1788970211.396139:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970211.396145:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044a81390 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:7931:x1875871102155136:12345-0@lo:104: 00010000:00010000:1.0:1788970211.396151:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396211:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788970211.396215:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044a81390 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:7931:x1875871102155136:12345-0@lo:104: Request processed in 72us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970211.396221:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788970211.396236:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788970211.396240:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049d371e0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875871102155136:0@lo:104: 00010000:00010000:1.0:1788970211.396241:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396247:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ecc93fa5 already unused, calling callback (000000005eca4434) 10000000:00010000:1.0:1788970211.396250:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970211.396258:0:7931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396267:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970211.396274:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970211.396280:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788970211.396315:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396322:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970211.396337:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396343:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 00000000ecc93fa5/0xc3abfebe76c6e4fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e505 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396355:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970211.396357:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396362:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a3d8a92 already unused, calling callback (000000005eca4434) 10000000:00010000:1.0:1788970211.396364:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396370:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970211.396375:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970211.396407:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788970211.396432:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396439:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970211.396443:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396449:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: 000000004a3d8a92/0xc3abfebe76c6e410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e417 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396462:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970211.396464:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970211.396465:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970211.396478:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008329fa25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102155264:0@lo:103: 00000100:00100000:1.0:1788970211.396506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970211.396539:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970211.396545:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102155392:0@lo:103: 00000100:00100000:1.0:1788970211.396575:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970211.396604:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155264 00000100:00100000:1.0:1788970211.396608:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155264 00010000:00010000:1.0:1788970211.396622:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 18 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970211.396641:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155392 00000100:00100000:1.0:1788970211.396644:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155392 00000100:00100000:3.0:1788970211.396651:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788970211.396652:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 19 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970211.396658:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e249408 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3649:x1875871102155264:12345-0@lo:103: 00010000:00010000:3.0:1788970211.396667:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970211.396672:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 19 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970211.396673:0:6509:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788970211.396678:0:6509:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788970211.396680:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 19 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970211.396690:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788970211.396691:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000031b77922/0xc3abfebe76c6e505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e4fe expref: 19 pid: 6518 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970211.396696:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788970211.396701:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970211.396701:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000946ab6f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3649:x1875871102155392:12345-0@lo:103: 00010000:00010000:1.0:1788970211.396707:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970211.396710:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 18 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396718:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 18 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396727:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2e956bd/0xc3abfebe76c6e417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e410 expref: 18 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970211.396729:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e249408 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3649:x1875871102155264:12345-0@lo:103: Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970211.396735:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788970211.396737:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396744:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396754:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396761:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396766:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396781:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396787:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0096da7 already unused, calling callback (000000007bcbfd51) 00010000:00010000:1.0:1788970211.396790:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396796:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396814:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970211.396824:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970211.396837:0:7931:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970211.396844:0:7931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970211.396847:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000946ab6f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3649:x1875871102155392:12345-0@lo:103: Request processed in 147us (273us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970211.396849:0:7931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0096da7/0xc3abfebe76c6e598 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970211.396853:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970211.396875:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102155392:0@lo:103: 00000100:00100000:1.0:1788970211.396882:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008329fa25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102155264:0@lo:103: 00010000:00010000:0.0:1788970211.397045:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970211.615984:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102155520:0@lo:41: 00000100:00100000:3.0:1788970211.616046:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970211.616944:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155520 00000100:00100000:2.0:1788970211.616953:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155520 00000100:00100000:2.0:1788970211.616994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970211.617001:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008439a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102155520:12345-0@lo:41: 00000004:00000024:2.0:1788970211.617031:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788970211.617100:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008439a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102155520:12345-0@lo:41: Request processed in 99us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970211.617107:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788970211.624503:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102155520:0@lo:41: 00010000:00010000:1.0:1788970212.383884:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970213.149037:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102155648:0@lo:41: 00000100:00100000:2.0:1788970213.149223:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970213.149356:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102155904:0@lo:400: 00000100:00100000:2.0:1788970213.149410:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970213.149433:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970213.149438:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008329fa25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102155776:0@lo:400: 00000100:00100000:2.0:1788970213.149465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970213.149500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155776 00000100:00100000:2.0:1788970213.149508:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155776 00000100:00100000:2.0:1788970213.149560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788970213.149568:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cfc0a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3650:x1875871102155776:12345-0@lo:400: 00000100:00100000:2.0:1788970213.149633:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cfc0a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3650:x1875871102155776:12345-0@lo:400: Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970213.149640:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788970213.149685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008329fa25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102155776:0@lo:400: 00000100:00100000:2.0:1788970213.149732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155904 00000100:00100000:2.0:1788970213.149735:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155904 00000100:00100000:2.0:1788970213.149765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970213.149771:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5d8e11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102155904:12345-0@lo:400: 00000100:00100000:2.0:1788970213.149806:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5d8e11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102155904:12345-0@lo:400: Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970213.149812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970213.149949:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102155648 00000100:00100000:3.0:1788970213.149954:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102155648 00000100:00100000:3.0:1788970213.149981:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970213.149987:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009db86f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102155648:12345-0@lo:41: 00000004:00000024:3.0:1788970213.150015:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788970213.150231:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe3aef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102155648:0@lo:41: 00000100:00100000:3.0:1788970213.150358:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009db86f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102155648:12345-0@lo:41: Request processed in 371us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970213.150365:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970213.150575:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008329fa25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102156032:0@lo:400: 00000100:00100000:0.0:1788970213.150609:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970213.150637:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970213.150643:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102156160:0@lo:400: 00000100:00100000:0.0:1788970213.150665:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970213.150776:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156160 00000100:00100000:3.0:1788970213.150781:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156160 00000100:00100000:1.0:1788970213.150804:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156032 00000100:00100000:1.0:1788970213.150810:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156032 00000100:00100000:3.0:1788970213.150822:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970213.150831:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b794f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102156160:12345-0@lo:400: 00000100:00100000:1.0:1788970213.150843:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788970213.150851:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007769c3e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102156032:12345-0@lo:400: 00000100:00100000:3.0:1788970213.150937:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b794f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102156160:12345-0@lo:400: Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970213.150944:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788970213.151147:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000048577114 x1875871102156160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970213.151160:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048577114 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102156160:0@lo:400: 00000100:00100000:0.0:1788970213.151174:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008329fa25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102156032:0@lo:400: 00010000:00080000:2.0:1788970213.151296:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bd2cc03f x1875871102155904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970213.151300:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007769c3e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102156032:12345-0@lo:400: Request processed in 41us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970213.151316:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970213.151319:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd2cc03f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102155904:0@lo:400: 00010000:00010000:3.0:1788970213.411931:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970214.428906:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970215.458561:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970216.483979:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788970216.732773:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970216.732784:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebb899800 from 1 10000000:01000000:2.0:1788970216.732790:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970216.732833:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: 00000000a0096da7/0xc3abfebe76c6e59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970216.732848:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: 00000000a0096da7/0xc3abfebe76c6e59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970216.732861:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: 00000000a0096da7/0xc3abfebe76c6e59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970216.732889:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee129a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102156416:0@lo:101: 00000100:00100000:2.0:1788970216.733017:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970216.733106:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a71c3291 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.733233:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156416 00000100:00100000:3.0:1788970216.733314:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156416 00000100:00100000:1.0:1788970216.733448:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970216.733463:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097619374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102156288:0@lo:41: 00000100:00100000:1.0:1788970216.733503:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970216.733552:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156288 00000100:00100000:1.0:1788970216.733556:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156288 00000100:00100000:1.0:1788970216.733593:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970216.733603:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be768729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102156288:12345-0@lo:41: 00000004:00000024:1.0:1788970216.733647:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788970216.733699:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be768729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102156288:12345-0@lo:41: Request processed in 98us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970216.733706:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970216.733772:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097619374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102156288:0@lo:41: 00000100:00100000:3.0:1788970216.734069:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970216.734090:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e2b3275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102156416:12345-0@lo:101: 00010000:00010000:3.0:1788970216.734102:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970216.734132:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073334602/0xc3abfebe76c6e5a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e59f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970216.734158:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073334602/0xc3abfebe76c6e5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970216.734170:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073334602/0xc3abfebe76c6e5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970216.734179:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073334602, rc 0) 00000100:00100000:3.0:1788970216.734217:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e2b3275 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102156416:12345-0@lo:101: Request processed in 140us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.734223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788970216.734408:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee129a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102156416:0@lo:101: 00010000:00010000:1.0:1788970216.734437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: 00000000a0096da7/0xc3abfebe76c6e59f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970216.734448:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: 00000000a0096da7/0xc3abfebe76c6e59f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970216.734554:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007503674c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102156544:0@lo:501: 00000100:00100000:1.0:1788970216.734587:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970216.736226:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156544 00000100:00100000:2.0:1788970216.736240:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156544 00000100:00100000:0.0:1788970216.736362:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cfb9cf07 going to sleep for 11 seconds 00000100:00100000:2.0:1788970216.736438:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788970216.736448:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062814369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102156544:12345-0@lo:501: 00000100:00100000:2.0:1788970216.736774:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062814369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102156544:12345-0@lo:501: Request processed in 326us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970216.736784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970216.736836:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007503674c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102156544:0@lo:501: 00000100:00100000:0.0:1788970216.736924:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102156672:0@lo:503: 00000100:00100000:0.0:1788970216.737006:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970216.737043:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca86da28 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.737162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156672 00000100:00100000:3.0:1788970216.737170:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156672 00000100:00100000:3.0:1788970216.737200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970216.737205:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7b3d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102156672:12345-0@lo:503: 00000100:00100000:0.0:1788970216.737333:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102156672:0@lo:503: 00000100:00100000:0.0:1788970216.738531:0:8159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8159:1875871102156800:0@lo:502: 00000100:00100000:3.0:1788970216.739019:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7b3d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102156672:12345-0@lo:503: Request processed in 1810us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.739040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970216.739331:0:8159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970216.739440:0:8159:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054811da6 going to sleep for 11 seconds 00000100:00100000:2.0:1788970216.740346:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156800 00000100:00100000:2.0:1788970216.740358:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156800 00000100:00100000:2.0:1788970216.740496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788970216.740506:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000130a3365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8159:x1875871102156800:12345-0@lo:502: 00000100:00100000:2.0:1788970216.740767:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000130a3365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8159:x1875871102156800:12345-0@lo:502: Request processed in 263us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970216.740776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970216.740865:0:8159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a3cea2b pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8159:1875871102156800:0@lo:502: 00000020:01000000:0.0:1788970216.740901:0:8159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970216.740918:0:8159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970216.740922:0:8159:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788970216.740931:0:8159:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7ebb899800 00000020:00000080:0.0:1788970216.740934:0:8159:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788970216.740998:0:8159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8159:1875871102156928:0@lo:502: 00000100:00100000:0.0:1788970216.741056:0:8159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970216.746259:0:8159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.747359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102156928 00000100:00100000:3.0:1788970216.747377:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102156928 00000100:00100000:3.0:1788970216.747468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788970216.747480:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8159:x1875871102156928:12345-0@lo:502: 00000100:00100000:3.0:1788970216.752180:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8159:x1875871102156928:12345-0@lo:502: Request processed in 4688us (11110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.752201:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788970216.756770:0:8159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8159:1875871102156928:0@lo:502: 00000020:01000000:2.0:1788970216.756836:0:8159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970216.756853:0:8159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970216.756856:0:8159:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788970216.756869:0:8159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788970216.756967:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788970216.757000:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970216.757014:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970216.757779:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970216.757816:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970216.757820:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0d2c000 from 1 10000000:01000000:2.0:1788970216.757823:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970216.757872:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970216.757882:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970216.757895:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970216.757921:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102157056:0@lo:101: 00000100:00100000:2.0:1788970216.758007:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970216.758334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157056 00000100:00100000:1.0:1788970216.758344:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157056 00000100:00100000:1.0:1788970216.758472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788970216.758484:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102157056:12345-0@lo:101: 00010000:00010000:1.0:1788970216.758502:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970216.758534:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e5ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970216.758564:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970216.758578:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970216.758588:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4400, rc 0) 00000100:00100000:2.0:1788970216.759333:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e884179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970216.759492:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102157056:12345-0@lo:101: Request processed in 1009us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970216.759502:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970216.760884:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102157056:0@lo:101: 00010000:00010000:2.0:1788970216.760915:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970216.760931:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970216.761690:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102157184:0@lo:501: 00000100:00100000:2.0:1788970216.761762:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970216.761801:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e884179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.762026:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157184 00000100:00100000:3.0:1788970216.762036:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157184 00000100:00100000:3.0:1788970216.762113:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788970216.762124:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102157184:12345-0@lo:501: 00000100:00100000:3.0:1788970216.762318:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102157184:12345-0@lo:501: Request processed in 195us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.762327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970216.763075:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102157184:0@lo:501: 00000100:00100000:2.0:1788970216.763129:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102157312:0@lo:503: 00000100:00100000:2.0:1788970216.763187:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970216.763236:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157312 00000100:00100000:3.0:1788970216.763243:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157312 00000100:00100000:3.0:1788970216.763294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788970216.763304:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102157312:12345-0@lo:503: 00000100:00100000:2.0:1788970216.763356:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e884179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.763455:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102157312:12345-0@lo:503: Request processed in 152us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.763461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788970216.763548:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102157312:0@lo:503: 00000100:00100000:2.0:1788970216.764334:0:8162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8162:1875871102157440:0@lo:502: 00000100:00100000:2.0:1788970216.764408:0:8162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970216.764449:0:8162:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.764450:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157440 00000100:00100000:3.0:1788970216.764458:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157440 00000100:00100000:3.0:1788970216.764511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788970216.764520:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8162:x1875871102157440:12345-0@lo:502: 00000100:00100000:3.0:1788970216.764648:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8162:x1875871102157440:12345-0@lo:502: Request processed in 128us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.764659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970216.765052:0:8162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8162:1875871102157440:0@lo:502: 00000020:01000000:2.0:1788970216.765083:0:8162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970216.765096:0:8162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970216.765099:0:8162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788970216.765110:0:8162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7eb0d2c000 00000020:00000080:2.0:1788970216.765113:0:8162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970216.765141:0:8162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8162:1875871102157568:0@lo:502: 00000100:00100000:2.0:1788970216.765182:0:8162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970216.765215:0:8162:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970216.765369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157568 00000100:00100000:3.0:1788970216.765375:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157568 00000100:00100000:3.0:1788970216.765426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788970216.765435:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8162:x1875871102157568:12345-0@lo:502: 00000100:00100000:3.0:1788970216.765514:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8162:x1875871102157568:12345-0@lo:502: Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970216.765533:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788970216.765623:0:8162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8162:1875871102157568:0@lo:502: 00000020:01000000:2.0:1788970216.765643:0:8162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970216.765647:0:8162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970216.765649:0:8162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788970216.765654:0:8162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788970216.769148:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788970216.769203:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970216.769283:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970216.769299:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970217.500664:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970218.269130:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102158080:0@lo:400: 00000100:00100000:0.0:1788970218.269197:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970218.269264:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788970218.269271:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102157696:0@lo:400: 00000100:00100000:0.0:1788970218.269300:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970218.269320:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102158208:0@lo:400: 00000100:00100000:0.0:1788970218.269344:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970218.269368:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102157824:0@lo:400: 00000100:00100000:0.0:1788970218.269410:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970218.269426:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970218.269431:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102157952:0@lo:400: 00000100:00100000:0.0:1788970218.269452:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970218.269868:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970218.269878:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102158336:0@lo:41: 00000100:00100000:3.0:1788970218.269916:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970218.269945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157696 00000100:00100000:3.0:1788970218.269951:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157696 00000100:00100000:3.0:1788970218.270003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788970218.270011:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3649:x1875871102157696:12345-0@lo:400: 00000100:00100000:3.0:1788970218.270059:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3649:x1875871102157696:12345-0@lo:400: Request processed in 48us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970218.270075:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788970218.270105:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158080 00000100:00100000:3.0:1788970218.270109:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158080 00000100:00100000:3.0:1788970218.270132:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157824 00000100:00100000:3.0:1788970218.270136:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157824 00000100:00100000:3.0:1788970218.270149:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970218.270155:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102158080:12345-0@lo:400: 00000100:00100000:3.0:1788970218.270186:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102158080:12345-0@lo:400: Request processed in 31us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970218.270192:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970218.270204:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970218.270209:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102157824:12345-0@lo:400: 00000100:00100000:3.0:1788970218.270257:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102157824:12345-0@lo:400: Request processed in 47us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970218.270263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970218.270302:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102157696:0@lo:400: 00010000:00080000:3.0:1788970218.270315:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7eaee43c00 x1875871102158080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970218.270326:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102158080:0@lo:400: 00000100:00100000:1.0:1788970218.271046:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158208 00000100:00100000:1.0:1788970218.271053:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158208 00000100:00100000:1.0:1788970218.271091:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102157952 00000100:00100000:1.0:1788970218.271095:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102157952 00000100:00100000:1.0:1788970218.271107:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158336 00000100:00100000:1.0:1788970218.271109:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158336 00000100:00100000:1.0:1788970218.271121:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788970218.271129:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102158208:12345-0@lo:400: 00000100:00100000:1.0:1788970218.271188:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102158208:12345-0@lo:400: Request processed in 59us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970218.271194:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788970218.271208:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970218.271218:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102157952:12345-0@lo:400: 00000100:00100000:1.0:1788970218.271256:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102157952:12345-0@lo:400: Request processed in 43us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970218.271262:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970218.271283:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970218.271289:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102158336:12345-0@lo:41: 00000004:00000024:1.0:1788970218.271314:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788970218.271361:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102158336:12345-0@lo:41: Request processed in 72us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970218.271367:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788970218.271601:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102158336:0@lo:41: 00000100:00100000:3.0:1788970218.271716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee40f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102158208:0@lo:400: 00000100:00100000:0.0:1788970218.271764:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102157952:0@lo:400: 00010000:00080000:0.0:1788970218.271777:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ea1ea7840 x1875871102157824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970218.271786:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102157824:0@lo:400: 00010000:00010000:1.0:1788970218.527056:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970219.548619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970220.572578:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970221.479340:0:8433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970221.479344:0:8433:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788970221.479346:0:8433:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788970221.479513:0:8433:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7eaed7c000 00000020:01000004:3.0:1788970221.479529:0:8433:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788970221.479541:0:8433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788970221.479564:0:8433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a7eaef6cd40) 00000020:00000080:3.0:1788970221.479579:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788970221.545326:0:8433:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788970221.545414:0:8433:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788970221.566826:0:8433:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788970221.567043:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788970221.567054:0:8433:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788970221.567065:0:8433:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3abfebe76c6e5c2 00000020:01000004:3.0:1788970221.567071:0:8433:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788970221.567091:0:8433:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788970221.567094:0:8433:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788970221.567100:0:8433:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788970221.567105:0:8433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788970221.567117:0:8433:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a7eaef699c0) 00000020:00000080:3.0:1788970221.567127:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788970221.574035:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970221.574228:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970221.574234:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788970221.580624:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970221.580637:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788970221.581348:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788970221.581355:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788970221.584638:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970221.584794:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788970221.584804:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788970221.589922:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788970221.589935:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1788970221.599757:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970221.613650:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970221.613892:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788970221.613899:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788970221.615354:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970221.615371:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788970221.617143:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788970221.617154:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788970221.622367:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970221.623019:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970221.623026:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788970221.623885:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788970221.623894:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788970221.663347:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970221.663681:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970221.663687:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788970221.681244:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788970221.684264:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788970221.686878:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788970221.686918:0:8433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788970221.686924:0:8433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970221.699933:0:8433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970221.700789:0:8433:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788970221.700794:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970221.700796:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970221.700797:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970221.700798:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970221.700799:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970221.700801:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970221.700802:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970221.700804:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970221.700805:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970221.700806:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970221.700808:0:8433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970221.700813:0:8433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788970221.700815:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970221.700816:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970221.700817:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970221.700818:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970221.700819:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970221.700820:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970221.700821:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970221.700822:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970221.700823:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970221.700824:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970221.700825:0:8433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970221.700854:0:8433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788970221.700876:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102158464:0@lo:253: 00000100:00100000:3.0:1788970221.700957:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.701024:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970221.705121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158464 00000100:00100000:1.0:1788970221.705156:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158464 00000100:00100000:1.0:1788970221.705230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788970221.705241:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8433:x1875871102158464:12345-0@lo:253: 20000000:01000000:1.0:1788970221.705589:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788970221.705593:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788970221.705599:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788970221.705602:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788970221.705860:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970221.705999:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788970221.706012:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788970221.706027:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788970221.706032:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788970221.706042:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788970221.706053:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788970221.706124:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788970221.706138:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1788970221.706140:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1788970221.706152:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788970221.706157:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788970221.706168:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788970221.706172:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1788970221.706199:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788970221.706207:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788970221.706220:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788970221.706248:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788970221.707656:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788970221.707679:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1788970221.707681:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1788970221.707696:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788970221.707703:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788970221.707716:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788970221.707722:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1788970221.707735:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788970221.707742:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788970221.707756:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788970221.707772:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788970221.708130:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788970221.708141:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1788970221.708143:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1788970221.708157:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788970221.708163:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788970221.708176:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788970221.708182:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1788970221.708195:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788970221.708200:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788970221.708212:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788970221.708226:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788970221.708237:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788970221.708239:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788970221.708243:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788970221.710520:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788970221.710528:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788970221.711159:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788970221.711607:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788970221.711638:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788970221.711656:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788970221.711667:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788970221.711669:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788970221.712730:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788970221.712776:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788970221.712807:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788970221.717735:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788970221.717770:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788970221.717784:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1788970221.717796:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788970221.717799:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788970221.719151:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788970221.719194:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788970221.719212:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788970221.719473:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788970221.719509:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788970221.719525:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788970221.719540:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788970221.719543:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788970221.720190:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788970221.720223:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788970221.720239:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788970221.720687:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788970221.720710:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788970221.720725:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788970221.720742:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788970221.720761:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720778:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720786:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720794:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720800:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720807:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720814:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720854:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.720871:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 18 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.720900:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158592:0@lo:104: 00000100:00100000:3.0:1788970221.720965:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970221.721021:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.721030:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 18 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.721038:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158720:0@lo:104: 00000100:00100000:3.0:1788970221.721060:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970221.721097:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.721106:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 18 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.721114:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a82940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158848:0@lo:104: 00000100:00100000:3.0:1788970221.721135:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970221.721152:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.721160:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 18 pid: 6517 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.721168:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a803c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158976:0@lo:104: 00000100:00100000:3.0:1788970221.721187:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970221.721202:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.721220:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 18 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.721229:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102159104:0@lo:104: 00000100:00100000:3.0:1788970221.721246:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.721256:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970221.721377:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158592 00000100:00100000:1.0:1788970221.721478:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158592 00000100:00100000:1.0:1788970221.721522:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158720 00000100:00100000:1.0:1788970221.721525:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158720 00000100:00100000:1.0:1788970221.721540:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158848 00000100:00100000:1.0:1788970221.721543:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158848 00000100:00100000:0.0:1788970221.721547:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102158976 00000100:00100000:1.0:1788970221.721555:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159104 00000100:00100000:0.0:1788970221.721555:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102158976 00000100:00100000:1.0:1788970221.721560:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159104 00000100:00100000:1.0:1788970221.721584:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970221.721592:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+7:6516:x1875871102158592:12345-0@lo:104: 00010000:00010000:1.0:1788970221.721605:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.721657:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970221.721669:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+7:6516:x1875871102158592:12345-0@lo:104: Request processed in 77us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.721867:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158592:0@lo:104: 00010000:00010000:3.0:1788970221.725557:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970221.725573:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.725587:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e80031a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970221.725592:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.725603:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970221.725611:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970221.725617:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970221.725676:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.725683:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970221.725711:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.725722:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788970221.725739:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e58a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e591 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.725743:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102159232:0@lo:103: 00010000:00010000:3.0:1788970221.725760:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970221.725764:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970221.725766:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970221.725813:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970221.725840:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970221.725868:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159232 00000100:00100000:1.0:1788970221.725872:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970221.725876:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159232 00000100:00100000:1.0:1788970221.725885:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e93593840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:6516:x1875871102158720:12345-0@lo:104: 00010000:00010000:1.0:1788970221.725897:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.725907:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 19 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.725950:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788970221.725960:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970221.725960:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3651:x1875871102159232:12345-0@lo:103: 00000100:00100000:1.0:1788970221.725970:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e93593840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:6516:x1875871102158720:12345-0@lo:104: Request processed in 89us (4908us total) trans 0 rc 0/0 00010000:00010000:0.0:1788970221.725974:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788970221.725979:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788970221.725984:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 19 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970221.725997:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788970221.725999:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 19 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970221.726008:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6516:x1875871102158848:12345-0@lo:104: 00010000:00010000:1.0:1788970221.726016:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.726017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e81534000/0xc3abfebe76c6e591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e58a expref: 19 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.726041:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970221.726069:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788970221.726076:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6516:x1875871102158848:12345-0@lo:104: Request processed in 71us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970221.726081:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3651:x1875871102159232:12345-0@lo:103: Request processed in 123us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.726087:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970221.726094:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970221.726108:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970221.726116:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6516:x1875871102158976:12345-0@lo:104: 00010000:00010000:1.0:1788970221.726124:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.726136:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102159232:0@lo:103: 00010000:00010000:1.0:1788970221.726158:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788970221.726171:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6516:x1875871102158976:12345-0@lo:104: Request processed in 56us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.726178:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970221.726191:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970221.726198:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6516:x1875871102159104:12345-0@lo:104: 00010000:00010000:1.0:1788970221.726206:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.726231:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788970221.726236:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6516:x1875871102159104:12345-0@lo:104: Request processed in 39us (4989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.726240:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788970221.726426:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788970221.726432:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726441:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e81535a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970221.726444:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726452:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970221.726459:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970221.726465:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970221.726499:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726512:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970221.726527:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726533:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e81535a00/0xc3abfebe76c6e560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e567 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726544:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788970221.726547:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726553:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970221.726556:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726564:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970221.726571:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970221.726576:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970221.726589:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726594:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970221.726599:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec215b800/0xc3abfebe76c6e544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e54b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726621:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970221.726625:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726630:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e81534c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970221.726633:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726640:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970221.726647:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970221.726653:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970221.726666:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726671:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970221.726683:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726690:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e81534c00/0xc3abfebe76c6e50c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e513 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726699:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970221.726702:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726718:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970221.726720:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726726:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970221.726732:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970221.726737:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970221.726750:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726755:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970221.726760:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726766:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec215bc00/0xc3abfebe76c6e495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e49c expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.726780:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970221.726782:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970221.726784:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970221.726796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102159360:0@lo:103: 00000100:00100000:2.0:1788970221.726828:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.726855:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970221.726861:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102159488:0@lo:103: 00000100:00100000:2.0:1788970221.726893:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.726932:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102159744:0@lo:103: 00000100:00100000:2.0:1788970221.726953:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.726970:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970221.726975:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102159616:0@lo:103: 00000100:00100000:2.0:1788970221.726994:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.727771:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159360 00000100:00100000:2.0:1788970221.727781:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159360 00010000:00010000:2.0:1788970221.727811:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 18 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.727834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159488 00000100:00100000:2.0:1788970221.727837:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159488 00010000:00010000:2.0:1788970221.727849:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 19 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.727860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159744 00000100:00100000:2.0:1788970221.727863:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159744 00010000:00010000:2.0:1788970221.727873:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 20 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.727884:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159616 00000100:00100000:2.0:1788970221.727886:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159616 00010000:00010000:2.0:1788970221.727896:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 21 pid: 6517 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.727909:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970221.728003:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3649:x1875871102159360:12345-0@lo:103: 00010000:00010000:2.0:1788970221.728018:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.728024:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 21 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728049:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 21 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728064:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.728122:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3649:x1875871102159360:12345-0@lo:103: Request processed in 205us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.728129:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970221.728144:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970221.728150:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:3649:x1875871102159488:12345-0@lo:103: 00010000:00010000:2.0:1788970221.728156:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.728161:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 20 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728168:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 20 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728177:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.728194:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:3649:x1875871102159488:12345-0@lo:103: Request processed in 45us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.728200:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970221.728210:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970221.728215:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3652:x1875871102159744:12345-0@lo:103: 00010000:00010000:2.0:1788970221.728221:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.728225:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 19 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728232:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 19 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728245:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.728269:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3652:x1875871102159744:12345-0@lo:103: Request processed in 54us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.728275:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970221.728286:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970221.728291:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3652:x1875871102159616:12345-0@lo:103: 00010000:00010000:2.0:1788970221.728297:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.728301:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 18 pid: 6517 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728310:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 18 pid: 6517 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728320:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728329:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728343:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728351:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728357:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728364:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728375:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970221.728401:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728409:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728418:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728428:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.728450:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0c18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3652:x1875871102159616:12345-0@lo:103: Request processed in 159us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.728456:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970221.728530:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102159616:0@lo:103: 00000100:00100000:2.0:1788970221.728538:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102159744:0@lo:103: 00010000:00010000:2.0:1788970221.728578:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e81535c00/0xc3abfebe76c6e567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e560 expref: 17 pid: 6516 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.728589:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158720:0@lo:104: 00010000:00010000:2.0:1788970221.728599:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4a00/0xc3abfebe76c6e54b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e544 expref: 16 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.728605:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a82940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158848:0@lo:104: 00010000:00010000:2.0:1788970221.728613:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e50c expref: 15 pid: 6517 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.728632:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a803c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102158976:0@lo:104: 00010000:00010000:2.0:1788970221.728642:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e49c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e495 expref: 14 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.728650:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875871102159104:0@lo:104: 00010000:00010000:2.0:1788970221.728671:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728680:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728686:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.728691:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b400/0xc3abfebe76c6e5d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970221.728702:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788970221.729135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102159488:0@lo:103: 00000100:00100000:0.0:1788970221.729145:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102159360:0@lo:103: 00010000:00010000:1.0:1788970221.730019:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970221.732847:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:8433:x1875871102158464:12345-0@lo:253: Request processed in 27599us (31879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.732863:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788970221.733567:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102158464:0@lo:253: 10000000:01000000:3.0:1788970221.733586:0:8433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788970221.733590:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970221.733592:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970221.733593:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970221.733594:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788970221.733596:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970221.733597:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970221.733599:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970221.733600:0:8433:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788970221.733602:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970221.733603:0:8433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788970221.733635:0:8433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7eaed7c000 from lustre-OST0000 10000000:01000000:3.0:1788970221.733668:0:8433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788970221.733671:0:8433:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788970221.733680:0:8433:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7e848519c0 local copy 10000000:01000000:3.0:1788970221.733684:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788970221.733723:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.733735:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.733746:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.733782:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102159872:0@lo:101: 00000100:00100000:3.0:1788970221.733822:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.733867:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970221.734088:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102159872 00000100:00100000:1.0:1788970221.734096:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102159872 00000100:00100000:1.0:1788970221.734147:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788970221.734156:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+13:8433:x1875871102159872:12345-0@lo:101: 00010000:00010000:1.0:1788970221.734167:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970221.734180:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e5de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e5d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.734202:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5d7 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.734212:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5d7 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.734220:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4c00, rc 0) 00000100:00100000:1.0:1788970221.734259:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102159872:12345-0@lo:101: Request processed in 104us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.734271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970221.735539:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102159872:0@lo:101: 00010000:00010000:2.0:1788970221.735559:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.735571:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.735692:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160000:0@lo:501: 00000100:00100000:2.0:1788970221.735737:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.735784:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea76de780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970221.736519:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160000 00000100:00100000:0.0:1788970221.736528:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160000 00000100:00100000:0.0:1788970221.736584:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788970221.736594:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160000:12345-0@lo:501: 00000100:00100000:0.0:1788970221.736692:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160000:12345-0@lo:501: Request processed in 99us (953us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788970221.736701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970221.737034:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160000:0@lo:501: 10000000:01000000:2.0:1788970221.737053:0:8433:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788970221.737076:0:8433:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788970221.737083:0:8433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737093:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737100:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737129:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788970221.737154:0:8433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7eaed7c000 10000000:01000000:2.0:1788970221.737160:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788970221.737165:0:8433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788970221.737168:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970221.737172:0:8433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788970221.737175:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788970221.737201:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737209:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737237:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.737254:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160128:0@lo:101: 00000100:00100000:2.0:1788970221.737285:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970221.737296:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970221.737304:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.737313:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9aa00 already unused, calling callback (ffffffffc116cc20) 00000100:00100000:2.0:1788970221.737317:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 10000000:00010000:0.0:1788970221.737317:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.737330:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.737335:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160128 10000000:00010000:0.0:1788970221.737339:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.737341:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160128 10000000:01000000:0.0:1788970221.737349:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970221.737370:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.737372:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1788970221.737409:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788970221.737411:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160128:12345-0@lo:101: 00010000:00010000:2.0:1788970221.737421:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970221.737438:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.737446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9aa00/0xc3abfebe76c6e5d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e5de expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.737460:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970221.737462:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970221.737463:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970221.737474:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102160256:0@lo:103: 00000100:00100000:0.0:1788970221.737511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970221.737515:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e5e5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737537:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737547:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737555:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99c00, rc 0) 00000100:00100000:2.0:1788970221.737597:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102160128:12345-0@lo:101: Request processed in 216us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.737603:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970221.737636:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160256 00000100:00100000:2.0:1788970221.737640:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160256 00000100:00100000:2.0:1788970221.737666:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970221.737673:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3649:x1875871102160256:12345-0@lo:103: 00010000:00010000:2.0:1788970221.737688:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.737699:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e5de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e5d7 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.737709:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.737739:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:3649:x1875871102160256:12345-0@lo:103: Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.737745:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970221.737772:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102160256:0@lo:103: 00000100:00100000:0.0:1788970221.738109:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160128:0@lo:101: 00010000:00010000:0.0:1788970221.738127:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.738137:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.738215:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160384:0@lo:501: 00000100:00100000:0.0:1788970221.738243:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.738267:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970221.738372:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160384 00000100:00100000:1.0:1788970221.738392:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160384 00000100:00100000:1.0:1788970221.738431:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788970221.738439:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160384:12345-0@lo:501: 00000100:00100000:1.0:1788970221.738542:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160384:12345-0@lo:501: Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.738550:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788970221.738583:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160384:0@lo:501: 00000100:00100000:0.0:1788970221.738611:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160512:0@lo:503: 00000100:00100000:0.0:1788970221.738654:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.738677:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970221.738731:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160512 00000100:00100000:2.0:1788970221.738736:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160512 00000100:00100000:2.0:1788970221.738769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788970221.738776:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160512:12345-0@lo:503: 00000100:00100000:2.0:1788970221.738853:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160512:12345-0@lo:503: Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.738860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788970221.739071:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160512:0@lo:503: 00000040:00080000:0.0:1788970221.739337:0:8433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970221.739446:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160640:0@lo:502: 00000100:00100000:0.0:1788970221.739484:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.739512:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970221.739530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160640 00000100:00100000:0.0:1788970221.739534:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160640 00000100:00100000:0.0:1788970221.739561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788970221.739569:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160640:12345-0@lo:502: 00000100:00100000:0.0:1788970221.741184:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160640:12345-0@lo:502: Request processed in 1609us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970221.741195:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970221.741452:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160640:0@lo:502: 00000040:00080000:2.0:1788970221.741722:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788970221.741755:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788970221.741769:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788970221.741783:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788970221.741795:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788970221.741807:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788970221.741840:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160768:0@lo:502: 00000100:00100000:2.0:1788970221.741885:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.742046:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160768 00000100:00100000:3.0:1788970221.742053:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160768 00000100:00100000:3.0:1788970221.742102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788970221.742112:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160768:12345-0@lo:502: 00000100:00100000:2.0:1788970221.742134:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.742211:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160768:12345-0@lo:502: Request processed in 101us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.742263:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160768:0@lo:502: 00000040:00080000:2.0:1788970221.742311:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788970221.742319:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788970221.743541:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970221.743550:0:8456:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788970221.743556:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970221.743558:0:8456:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788970221.743566:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970221.743593:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a7d81aecd40) 00000020:00000080:2.0:1788970221.743615:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788970221.743622:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788970221.743694:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7eaed7c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788970221.743701:0:8456:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788970221.743707:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3abfebe76c6e5fa 00000100:00100000:3.0:1788970221.752556:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1788970221.753350:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788970221.753696:0:8456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788970221.759567:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788970221.761216:0:8456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788970221.767624:0:8456:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788970221.767986:0:8456:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788970221.775984:0:8456:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788970221.778000:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788970221.778012:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970221.778020:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970221.778022:0:8456:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788970221.778025:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970221.778029:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970221.778030:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970221.778033:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970221.778035:0:8456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788970221.778058:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970221.778061:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970221.778062:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788970221.778065:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788970221.778517:0:8433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788970221.778548:0:8433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788970221.778621:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.778634:0:8433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970221.778642:0:8433:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eaed7c000 from 1 10000000:01000000:3.0:1788970221.778645:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970221.778682:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.778691:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.778702:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.778732:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160896:0@lo:101: 00000100:00100000:3.0:1788970221.778796:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.778839:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970221.780512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102160896 00000100:00100000:2.0:1788970221.780529:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102160896 00000100:00100000:2.0:1788970221.780586:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788970221.780597:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:8433:x1875871102160896:12345-0@lo:101: 00010000:00010000:2.0:1788970221.780612:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970221.780629:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e601 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.780656:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.780667:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.780675:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98000, rc 0) 00000100:00100000:2.0:1788970221.780741:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102160896:12345-0@lo:101: Request processed in 147us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.780748:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788970221.780933:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102160896:0@lo:101: 00010000:00010000:3.0:1788970221.780950:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.780960:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.781062:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161024:0@lo:501: 00000100:00100000:3.0:1788970221.781095:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.781132:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.781151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161024 00000100:00100000:3.0:1788970221.781155:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161024 00000100:00100000:3.0:1788970221.781177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970221.781184:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161024:12345-0@lo:501: 00000100:00100000:3.0:1788970221.781310:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161024:12345-0@lo:501: Request processed in 126us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.781317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970221.781341:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161024:0@lo:501: 00000100:00100000:3.0:1788970221.781365:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161152:0@lo:503: 00000100:00100000:3.0:1788970221.781437:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.781446:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.781463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161152 00000100:00100000:3.0:1788970221.781472:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161152 00000100:00100000:3.0:1788970221.781499:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788970221.781505:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161152:12345-0@lo:503: 00000100:00100000:3.0:1788970221.781579:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161152:12345-0@lo:503: Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.781586:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788970221.781619:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161152:0@lo:503: 00000040:00080000:3.0:1788970221.781832:0:8433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970221.781890:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161280:0@lo:502: 00000100:00100000:3.0:1788970221.781920:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.781930:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.781946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161280 00000100:00100000:3.0:1788970221.781949:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161280 00000100:00100000:3.0:1788970221.781965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788970221.781971:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161280:12345-0@lo:502: 00000100:00100000:3.0:1788970221.782042:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161280:12345-0@lo:502: Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.782049:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788970221.782077:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161280:0@lo:502: 00000040:00080000:3.0:1788970221.782269:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788970221.782295:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788970221.782314:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161408:0@lo:502: 00000100:00100000:3.0:1788970221.782345:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970221.782355:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.782373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161408 00000100:00100000:3.0:1788970221.782377:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161408 00000100:00100000:3.0:1788970221.782420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970221.782432:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161408:12345-0@lo:502: 00000100:00100000:3.0:1788970221.782506:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161408:12345-0@lo:502: Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.782513:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970221.782543:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161408:0@lo:502: 00000040:00080000:3.0:1788970221.782579:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788970221.782586:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788970221.785604:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970221.785619:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970221.785622:0:8460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788970221.785630:0:8460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7eaed7c000 00000020:00000080:0.0:1788970221.785633:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970221.785649:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970221.785653:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970221.785655:0:8460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788970221.785658:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788970221.785711:0:8433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788970221.785743:0:8433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970221.785757:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.785770:0:8433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970221.785810:0:8433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788970221.785813:0:8433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7eaed7c000 10000000:01000000:0.0:1788970221.785816:0:8433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7eaed7c000 10000000:01000000:0.0:1788970221.785828:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970221.785834:0:8433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eaed7c000 from 1 10000000:01000000:0.0:1788970221.785837:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970221.785873:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.785882:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.785892:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.785915:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161536:0@lo:101: 00000100:00100000:0.0:1788970221.785981:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.786018:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970221.786041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161536 00000100:00100000:0.0:1788970221.786049:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161536 00000100:00100000:0.0:1788970221.786102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970221.786112:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8433:x1875871102161536:12345-0@lo:101: 00010000:00010000:0.0:1788970221.786127:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970221.786140:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e60f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.786162:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.786174:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.786183:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7e80030000, rc 0) 00000100:00100000:0.0:1788970221.786232:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161536:12345-0@lo:101: Request processed in 122us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970221.786239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970221.786290:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161536:0@lo:101: 00010000:00010000:0.0:1788970221.786305:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970221.786314:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970221.786417:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161664:0@lo:501: 00000100:00100000:0.0:1788970221.786446:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.786462:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970221.791497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161664 00000100:00100000:2.0:1788970221.791514:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161664 00000100:00100000:2.0:1788970221.791577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788970221.791588:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161664:12345-0@lo:501: 00000100:00100000:2.0:1788970221.791769:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161664:12345-0@lo:501: Request processed in 182us (5321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.791776:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788970221.791821:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161664:0@lo:501: 00000100:00100000:0.0:1788970221.791870:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161792:0@lo:503: 00000100:00100000:0.0:1788970221.791918:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.791948:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970221.792545:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161792 00000100:00100000:1.0:1788970221.792552:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161792 00000100:00100000:1.0:1788970221.792593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970221.792600:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161792:12345-0@lo:503: 00000100:00100000:1.0:1788970221.792694:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161792:12345-0@lo:503: Request processed in 94us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.792701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788970221.793366:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161792:0@lo:503: 00000040:00080000:0.0:1788970221.793644:0:8433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970221.793734:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161920:0@lo:502: 00000100:00100000:0.0:1788970221.793783:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.793828:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970221.794051:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102161920 00000100:00100000:2.0:1788970221.794057:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102161920 00000100:00100000:2.0:1788970221.794100:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788970221.794108:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161920:12345-0@lo:502: 00000100:00100000:2.0:1788970221.794229:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102161920:12345-0@lo:502: Request processed in 121us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.794236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788970221.795497:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102161920:0@lo:502: 00000040:00080000:0.0:1788970221.795722:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788970221.795753:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788970221.795769:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788970221.795794:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788970221.795810:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788970221.795823:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788970221.795837:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788970221.795852:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788970221.795873:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788970221.795887:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788970221.795899:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788970221.795912:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788970221.795924:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788970221.795953:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788970221.795969:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788970221.795981:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788970221.795992:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788970221.796005:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788970221.796017:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788970221.796030:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788970221.796045:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788970221.796058:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788970221.796072:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788970221.796086:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788970221.796100:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788970221.796114:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788970221.796127:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788970221.796140:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788970221.796153:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788970221.796179:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788970221.796195:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788970221.796210:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788970221.796223:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788970221.796236:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788970221.796250:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788970221.796263:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788970221.797113:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788970221.797161:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102162048:0@lo:502: 00000100:00100000:0.0:1788970221.797234:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970221.797320:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970221.801087:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162048 00000100:00100000:2.0:1788970221.801101:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162048 00000100:00100000:2.0:1788970221.801151:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788970221.801160:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102162048:12345-0@lo:502: 00000100:00100000:2.0:1788970221.801339:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102162048:12345-0@lo:502: Request processed in 179us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.801347:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788970221.801670:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102162048:0@lo:502: 00000040:00080000:0.0:1788970221.801748:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788970221.801761:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788970221.802187:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788970221.802204:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a7eaef6b380) 00000020:00000080:3.0:1788970221.802225:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788970221.802314:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7eaed7c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788970221.802319:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eaed7c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788970221.802322:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eaed7c000 3 00010000:00080000:3.0:1788970221.802348:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d82192800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970221.804399:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788970221.804617:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788970221.804657:0:8461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970221.804669:0:8461:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3abfebe76c6e624 00000100:00080000:3.0:1788970221.804678:0:8461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970221.804688:0:8461:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7d82192800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970221.804724:0:8461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d81a83840 x1875871102162176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970221.804748:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788970221.806910:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102162176:0@lo:38: 00000100:00100000:2.0:1788970221.806982:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.807045:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102162304:0@lo:400: 00000100:00100000:2.0:1788970221.807068:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.807087:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970221.807093:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102162688:0@lo:400: 00000100:00100000:2.0:1788970221.807115:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.807147:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102162432:0@lo:400: 00000100:00100000:2.0:1788970221.807169:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.807189:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970221.807195:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102162560:0@lo:400: 00000100:00100000:2.0:1788970221.807214:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.807244:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162176 00000100:00100000:2.0:1788970221.807251:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162176 00000100:00100000:2.0:1788970221.807285:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162304 00000100:00100000:2.0:1788970221.807288:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162304 00000100:00100000:2.0:1788970221.807311:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162560 00000100:00100000:2.0:1788970221.807321:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162560 00000100:00100000:2.0:1788970221.807339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970221.807346:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102162304:12345-0@lo:400: 00000100:00100000:2.0:1788970221.807546:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102162304:12345-0@lo:400: Request processed in 200us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.807554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970221.807571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970221.807578:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102162560:12345-0@lo:400: 00000100:00100000:2.0:1788970221.807608:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102162560:12345-0@lo:400: Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.807614:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970221.807626:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970221.807630:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102162176:12345-0@lo:38: 00010000:00080000:2.0:1788970221.807651:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1788970221.807682:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3abfebe76c6e62b 00000004:00100000:2.0:1788970221.807699:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970221.807728:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec9c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970221.807765:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875871102162176:12345-0@lo:38: Request processed in 134us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.807771:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970221.807795:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162688 00000100:00100000:2.0:1788970221.807799:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162688 00000100:00100000:2.0:1788970221.807821:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162432 00000100:00100000:2.0:1788970221.807824:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162432 00000100:00100000:2.0:1788970221.807836:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788970221.807841:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102162688:12345-0@lo:400: 00000100:00100000:2.0:1788970221.807874:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102162688:12345-0@lo:400: Request processed in 32us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.807887:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788970221.807899:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970221.807904:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102162432:12345-0@lo:400: 00000100:00100000:2.0:1788970221.807932:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102162432:12345-0@lo:400: Request processed in 28us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.807937:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788970221.808049:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d81a81a40 x1875871102162560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970221.808062:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102162560:0@lo:400: 00000100:00100000:2.0:1788970221.808074:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102162432:0@lo:400: 00000100:00100000:2.0:1788970221.808099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102162688:0@lo:400: 00010000:00080000:2.0:1788970221.808110:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d81a80b40 x1875871102162304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970221.808118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102162304:0@lo:400: 00010000:00080000:2.0:1788970221.808142:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d81a83840 x1875871102162176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970221.808149:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970221.808155:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788970221.808162:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788970221.808167:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788970221.808169:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970221.808174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102162176:0@lo:38: 00000020:01000004:2.0:1788970221.808832:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788970221.808855:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a7d81ae99c0) 00000020:00000080:2.0:1788970221.808874:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788970221.808969:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7eaed7c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788970221.808973:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eaed7c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788970221.808975:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eaed7c000 3 00010000:00080000:2.0:1788970221.809001:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7eaec9d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970221.813677:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788970221.813878:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788970221.813921:0:8461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788970221.813934:0:8461:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc3abfebe76c6e639 00000100:00080000:2.0:1788970221.813945:0:8461:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970221.813956:0:8461:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a7eaec9d800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970221.813990:0:8461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7eaeef03c0 x1875871102162816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970221.814021:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788970221.815553:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102162816:0@lo:38: 00000100:00100000:1.0:1788970221.815630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.819377:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162816 00000100:00100000:2.0:1788970221.819478:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162816 00000100:00100000:2.0:1788970221.819549:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970221.819557:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102162816:12345-0@lo:38: 00010000:00080000:2.0:1788970221.819588:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1788970221.819626:0:6524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc3abfebe76c6e640 00000004:00100000:2.0:1788970221.819644:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970221.819680:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec83800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970221.819786:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875871102162816:12345-0@lo:38: Request processed in 229us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.819794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788970221.819916:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:1.0:1788970221.820121:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7eaeef03c0 x1875871102162816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970221.820134:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970221.820143:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788970221.820151:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788970221.820156:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788970221.820158:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec9d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788970221.820165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102162816:0@lo:38: 00000020:01000000:1.0:1788970221.820729:0:8433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788970221.820760:0:8433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970221.820781:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.820793:0:8433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788970221.820837:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788970221.820839:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970221.820840:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970221.820841:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970221.820843:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970221.820844:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970221.820845:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970221.820847:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970221.820848:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970221.820850:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970221.820851:0:8433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970221.820855:0:8433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788970221.820857:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970221.820858:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970221.820859:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970221.820861:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970221.820862:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970221.820863:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970221.820864:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970221.820865:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970221.820866:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970221.820867:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970221.820868:0:8433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970221.820889:0:8433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788970221.820904:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102162944:0@lo:253: 00000100:00100000:1.0:1788970221.820949:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970221.820985:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.821065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102162944 00000100:00100000:3.0:1788970221.821071:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102162944 00000100:00100000:3.0:1788970221.821144:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788970221.821154:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102162944:12345-0@lo:253: 20000000:01000000:3.0:1788970221.821194:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788970221.821210:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788970221.837205:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970221.837249:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788970221.837274:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788970221.837289:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788970221.837310:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.837328:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.837337:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.837344:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.837676:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.837691:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 16 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.837705:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a82580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102163072:0@lo:104: 00000100:00100000:3.0:1788970221.837765:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970221.837996:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.838005:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 16 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.838013:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102163200:0@lo:104: 00000100:00100000:3.0:1788970221.838043:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970221.838208:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788970221.838229:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.838425:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:8433:x1875871102162944:12345-0@lo:253: Request processed in 17271us (17473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.838436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788970221.838597:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163072 00000100:00100000:0.0:1788970221.838604:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163072 00000100:00100000:1.0:1788970221.838846:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163200 00000100:00100000:1.0:1788970221.838858:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163200 00000100:00100000:1.0:1788970221.838881:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970221.838890:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5731850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6540:x1875871102163072:12345-0@lo:104: 00010000:00010000:1.0:1788970221.838905:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.838999:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970221.839006:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5731850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6540:x1875871102163072:12345-0@lo:104: Request processed in 117us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.839012:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970221.839048:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970221.839054:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102163200:12345-0@lo:104: 00010000:00010000:1.0:1788970221.839062:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.839096:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788970221.839101:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102163200:12345-0@lo:104: Request processed in 47us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.839106:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970221.839158:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:8433:1875871102162944:0@lo:253: 10000000:01000000:1.0:1788970221.839170:0:8433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788970221.839174:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970221.839176:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970221.839177:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970221.839178:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970221.839180:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970221.839181:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970221.839182:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970221.839184:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970221.839185:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970221.839193:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970221.839194:0:8433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970221.839208:0:8433:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788970221.839376:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970221.839408:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839417:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e81534a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970221.839420:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839428:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970221.839435:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970221.839442:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970221.839470:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839477:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970221.839502:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839509:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e81534a00/0xc3abfebe76c6e552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e559 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839521:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970221.839525:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839537:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e80030200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970221.839540:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839546:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970221.839552:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970221.839557:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970221.839571:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839576:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970221.839589:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839596:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e80030200/0xc3abfebe76c6e536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e53d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839612:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970221.839614:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970221.839616:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970221.839629:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102163328:0@lo:103: 00000100:00100000:2.0:1788970221.839659:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.839703:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102163456:0@lo:103: 00000100:00100000:2.0:1788970221.839724:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970221.839768:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163328 00000100:00100000:2.0:1788970221.839772:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163328 00010000:00010000:2.0:1788970221.839793:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 16 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.839812:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163456 00000100:00100000:2.0:1788970221.839815:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163456 00010000:00010000:2.0:1788970221.839825:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 17 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970221.839843:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970221.839849:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:3650:x1875871102163328:12345-0@lo:103: 00010000:00010000:2.0:1788970221.839859:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.839865:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 17 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839874:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 17 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839890:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.839917:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:3650:x1875871102163328:12345-0@lo:103: Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.839923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970221.839936:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970221.839942:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3651:x1875871102163456:12345-0@lo:103: 00010000:00010000:2.0:1788970221.839948:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970221.839952:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 16 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839961:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 16 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839978:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.839986:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970221.839999:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007379733s 00010000:00010000:2.0:1788970221.840004:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840010:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840016:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840022:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840027:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970221.840031:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840038:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840047:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970221.840055:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970221.840081:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3651:x1875871102163456:12345-0@lo:103: Request processed in 139us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970221.840091:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970221.840119:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102163456:0@lo:103: 00000100:00100000:2.0:1788970221.840133:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102163328:0@lo:103: 00010000:00010000:0.0:1788970221.841932:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970221.843674:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec215b600/0xc3abfebe76c6e559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e552 expref: 15 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.843695:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a82580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102163072:0@lo:104: 00010000:00010000:3.0:1788970221.843706:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e81535000/0xc3abfebe76c6e53d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e536 expref: 14 pid: 6516 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970221.843714:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102163200:0@lo:104: 00010000:00010000:3.0:1788970221.843735:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.843745:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.843751:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.843757:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e647 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788970221.847819:0:8433:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788970221.847977:0:8433:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788970221.848163:0:8433:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788970221.848647:0:8433:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788970221.848844:0:8433:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788970221.849037:0:8433:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788970221.851854:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788970221.856171:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102163584:0@lo:41: 00000100:00100000:0.0:1788970221.856239:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970221.857653:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163584 00000100:00100000:1.0:1788970221.857665:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163584 00000100:00100000:1.0:1788970221.857719:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970221.857728:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102163584:12345-0@lo:41: 00000004:00000024:1.0:1788970221.857762:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788970221.858532:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102163584:12345-0@lo:41: Request processed in 801us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.858541:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788970221.858612:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102163584:0@lo:41: 00002000:00080000:1.0:1788970221.859564:0:8433:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788970221.859570:0:8433:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788970221.859602:0:8433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788970221.859636:0:8433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788970221.859654:0:8433:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788970221.859670:0:8433:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788970221.871058:0:8433:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970221.871214:0:8433:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788970222.622616:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970222.757743:0:8517:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970222.757961:0:8517:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788970223.392219:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970223.392246:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102163712:0@lo:41: 00000100:00100000:0.0:1788970223.392312:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970223.392483:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163712 00000100:00100000:3.0:1788970223.392498:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163712 00000100:00100000:3.0:1788970223.392546:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970223.392556:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102163712:12345-0@lo:41: 00000004:00000024:3.0:1788970223.392588:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788970223.392631:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102163712:12345-0@lo:41: Request processed in 76us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970223.392649:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970223.392725:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102163712:0@lo:41: 00010000:00010000:1.0:1788970223.645273:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970224.668549:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970225.692605:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788970225.886472:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788970225.886480:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7ebb899800 from 30 10000000:01000000:2.0:1788970225.886486:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970225.886528:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.886540:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.886552:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.886574:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102163840:0@lo:101: 00000100:00100000:2.0:1788970225.886639:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.886711:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86307d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970225.886780:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163840 00000100:00100000:1.0:1788970225.886788:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163840 00000100:00100000:1.0:1788970225.886850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788970225.886870:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:6521:x1875871102163840:12345-0@lo:101: 00010000:00010000:1.0:1788970225.886883:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970225.886896:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e64e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970225.886919:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970225.886929:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970225.886937:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4800, rc 0) 00000100:00100000:1.0:1788970225.886981:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102163840:12345-0@lo:101: Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970225.886987:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788970225.887955:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102163840:0@lo:101: 00010000:00010000:3.0:1788970225.887979:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.887990:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970225.888063:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102163968:0@lo:501: 00000100:00100000:3.0:1788970225.888107:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.888138:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.891956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102163968 00000100:00100000:2.0:1788970225.891974:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102163968 00000100:00100000:2.0:1788970225.892042:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788970225.892052:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102163968:12345-0@lo:501: 00000100:00100000:2.0:1788970225.892230:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102163968:12345-0@lo:501: Request processed in 180us (4122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.892237:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788970225.892300:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102163968:0@lo:501: 00000100:00100000:2.0:1788970225.892348:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164096:0@lo:503: 00000100:00100000:2.0:1788970225.892429:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.892467:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86307840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.892481:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164096 00000100:00100000:2.0:1788970225.892485:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164096 00000100:00100000:2.0:1788970225.892508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788970225.892515:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102164096:12345-0@lo:503: 00000100:00100000:2.0:1788970225.892591:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102164096:12345-0@lo:503: Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.892598:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788970225.892638:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164096:0@lo:503: 00000100:00100000:2.0:1788970225.892849:0:8672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8672:1875871102164224:0@lo:502: 00000100:00100000:2.0:1788970225.892884:0:8672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.892903:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164224 00000100:00100000:2.0:1788970225.892908:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164224 00000100:00100000:2.0:1788970225.892943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788970225.892950:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8672:x1875871102164224:12345-0@lo:502: 00000100:00100000:2.0:1788970225.893019:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8672:x1875871102164224:12345-0@lo:502: Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.893026:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788970225.893054:0:8672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86307a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.893066:0:8672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8672:1875871102164224:0@lo:502: 00000100:00100000:2.0:1788970225.893104:0:8672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8672:1875871102164352:0@lo:502: 00000100:00100000:2.0:1788970225.893132:0:8672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.893149:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164352 00000100:00100000:2.0:1788970225.893152:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164352 00000100:00100000:2.0:1788970225.893171:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788970225.893183:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8672:x1875871102164352:12345-0@lo:502: 00000100:00100000:2.0:1788970225.893242:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:8672:x1875871102164352:12345-0@lo:502: Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.893249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788970225.893277:0:8672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.893288:0:8672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8672:1875871102164352:0@lo:502: 00000040:00080000:2.0:1788970225.893306:0:8672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788970225.893357:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788970225.893374:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970225.893406:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893416:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970225.893425:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788970225.893427:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebb899800 from 5 10000000:01000000:2.0:1788970225.893430:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970225.893453:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893475:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893484:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.893497:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164480:0@lo:101: 00000100:00100000:2.0:1788970225.893522:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.893543:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.893554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164480 00000100:00100000:2.0:1788970225.893558:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164480 00000100:00100000:2.0:1788970225.893577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788970225.893583:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102164480:12345-0@lo:101: 00010000:00010000:2.0:1788970225.893591:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970225.893602:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e65c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893623:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893633:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893641:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99000, rc 0) 00000100:00100000:2.0:1788970225.893668:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102164480:12345-0@lo:101: Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.893673:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788970225.893702:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164480:0@lo:101: 00010000:00010000:2.0:1788970225.893713:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.893720:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.893758:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164608:0@lo:256: 00000100:00100000:2.0:1788970225.893787:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.893800:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.893818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164608 00000100:00100000:2.0:1788970225.893822:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164608 00000100:00100000:2.0:1788970225.893841:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788970225.893846:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102164608:12345-0@lo:256: 20000000:01000000:2.0:1788970225.893856:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970225.893870:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970225.893873:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788970225.893940:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102164608:12345-0@lo:256: Request processed in 94us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.893947:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788970225.893975:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164608:0@lo:256: 10000000:01000000:2.0:1788970225.894008:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970225.894012:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894020:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970225.894027:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788970225.894029:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788970225.894031:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788970225.894046:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894052:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894057:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.894076:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164736:0@lo:101: 00000100:00100000:2.0:1788970225.894098:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.894110:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.894120:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164736 00000100:00100000:2.0:1788970225.894123:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164736 00000100:00100000:2.0:1788970225.894140:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788970225.894145:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102164736:12345-0@lo:101: 00010000:00010000:2.0:1788970225.894150:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970225.894158:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e66a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894170:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894177:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894184:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99e00, rc 0) 00000100:00100000:2.0:1788970225.894208:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102164736:12345-0@lo:101: Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.894214:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788970225.894240:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164736:0@lo:101: 00010000:00010000:2.0:1788970225.894250:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.894257:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.894309:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164864:0@lo:501: 00000100:00100000:2.0:1788970225.894332:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.894344:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.894355:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164864 00000100:00100000:2.0:1788970225.894359:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164864 00000100:00100000:2.0:1788970225.894378:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788970225.894408:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102164864:12345-0@lo:501: 00000100:00100000:2.0:1788970225.894514:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102164864:12345-0@lo:501: Request processed in 107us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.894521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788970225.894550:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164864:0@lo:501: 00000100:00100000:2.0:1788970225.894572:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164992:0@lo:503: 00000100:00100000:2.0:1788970225.894607:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.894622:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.894632:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102164992 00000100:00100000:2.0:1788970225.894635:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102164992 00000100:00100000:2.0:1788970225.894653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788970225.894659:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102164992:12345-0@lo:503: 00000100:00100000:2.0:1788970225.894727:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102164992:12345-0@lo:503: Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.894734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788970225.894766:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102164992:0@lo:503: 00000100:00100000:0.0:1788970225.900083:0:8673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8673:1875871102165120:0@lo:502: 00000100:00100000:0.0:1788970225.900187:0:8673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970225.900451:0:8673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.900531:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165120 00000100:00100000:2.0:1788970225.900539:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165120 00000100:00100000:2.0:1788970225.900606:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788970225.900622:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8673:x1875871102165120:12345-0@lo:502: 00000100:00100000:2.0:1788970225.900752:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8673:x1875871102165120:12345-0@lo:502: Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.900760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788970225.901496:0:8673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8673:1875871102165120:0@lo:502: 00000020:01000000:0.0:1788970225.901531:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970225.901539:0:8673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788970225.901551:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970225.901553:0:8673:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788970225.901558:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970225.901562:0:8673:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:0.0:1788970225.901583:0:8673:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788970225.901586:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970225.901600:0:8673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a7e8fc83380) 00000020:00000080:0.0:1788970225.901621:0:8673:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788970225.901626:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970225.901708:0:8673:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788970225.901714:0:8673:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788970225.901721:0:8673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6e67f 00010000:00080000:0.0:1788970225.901748:0:8673:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d81acb800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970225.903164:0:8673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788970225.921878:0:8673:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788970225.921905:0:8673:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788970225.922186:0:8673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970225.924994:0:8673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970225.925145:0:8673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788970225.925252:0:8673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788970225.926760:0:8676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970225.926766:0:8676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788970225.932012:0:8673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788970225.932031:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788970225.932094:0:8673:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788970225.932135:0:8673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e686 00000100:00080000:2.0:1788970225.932146:0:8673:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970225.932159:0:8673:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7d81acb800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970225.935972:0:8673:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7eaeef2580 x1875871102165248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970225.936010:0:8673:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788970225.936144:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970225.936152:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.936155:0:8673:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788970225.936158:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970225.936162:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.936163:0:8673:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970225.936166:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970225.936168:0:8673:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788970225.936200:0:8673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8673:1875871102165376:0@lo:502: 00000100:00100000:1.0:1788970225.936442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102165248:0@lo:8: 00000100:00100000:1.0:1788970225.936519:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970225.936840:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165248 00000100:00100000:3.0:1788970225.936846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102165888:0@lo:400: 00000100:00100000:0.0:1788970225.936849:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165248 00000100:00100000:3.0:1788970225.936888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970225.936891:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970225.936901:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875871102165248:12345-0@lo:8: 00000100:00100000:3.0:1788970225.936917:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970225.936925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102165504:0@lo:400: 00010000:00080000:0.0:1788970225.936945:0:8440:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000100:00100000:3.0:1788970225.936953:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.936976:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102166016:0@lo:400: 00000020:00000080:0.0:1788970225.936979:0:8440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e68d 00000100:00100000:3.0:1788970225.937006:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1788970225.937026:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a7d81aca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788970225.937031:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788970225.937035:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788970225.937037:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102165632:0@lo:400: 00000100:00100000:3.0:1788970225.937064:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.937083:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102166144:0@lo:400: 00000100:00100000:3.0:1788970225.937108:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1788970225.937111:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788970225.937127:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970225.937133:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102165760:0@lo:400: 00000100:00100000:3.0:1788970225.937171:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.937220:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165888 00000100:00100000:3.0:1788970225.937224:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165888 00002000:00080000:0.0:1788970225.937346:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788970225.937405:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8a7d81ac9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970225.937455:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102165248:12345-0@lo:8: Request processed in 554us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970225.937472:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788970225.937525:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaeef2580 x1875871102165248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970225.937535:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970225.937543:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788970225.937551:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970225.937556:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788970225.937558:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d81acb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970225.937569:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970225.937573:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102165248:0@lo:8: 00000100:00100000:2.0:1788970225.937704:0:8673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970225.937734:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165376 00000100:00100000:0.0:1788970225.937739:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165376 00000100:00100000:2.0:1788970225.937743:0:8673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86307840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970225.937773:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788970225.937781:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8673:x1875871102165376:12345-0@lo:502: 00000100:00100000:3.0:1788970225.937806:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165632 00000100:00100000:3.0:1788970225.937811:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165632 00000100:00100000:3.0:1788970225.937887:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970225.937896:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102165888:12345-0@lo:400: 00000100:00100000:0.0:1788970225.937903:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:8673:x1875871102165376:12345-0@lo:502: Request processed in 120us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970225.937911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788970225.937947:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102165888:12345-0@lo:400: Request processed in 52us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.937953:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970225.937968:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970225.937974:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102165632:12345-0@lo:400: 00000100:00100000:3.0:1788970225.938011:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102165632:12345-0@lo:400: Request processed in 37us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.938017:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970225.938037:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165504 00000100:00100000:3.0:1788970225.938040:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165504 00000100:00100000:3.0:1788970225.938058:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166016 00000100:00100000:3.0:1788970225.938061:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166016 00000100:00100000:3.0:1788970225.938080:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166144 00000100:00100000:3.0:1788970225.938082:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166144 00000100:00100000:3.0:1788970225.938092:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102165760 00000100:00100000:3.0:1788970225.938095:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102165760 00000100:00100000:3.0:1788970225.938105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970225.938110:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102165504:12345-0@lo:400: 00000100:00100000:3.0:1788970225.938138:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102165504:12345-0@lo:400: Request processed in 28us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.938144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970225.938153:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970225.938165:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102166016:12345-0@lo:400: 00000004:00080000:1.0:1788970225.938284:0:8676:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788970225.938345:0:8676:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 245204962955ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788970225.938352:0:8676:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788970225.938416:0:8677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102166272:0@lo:700: 00000100:00100000:1.0:1788970225.938449:0:8677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970225.938487:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166272 00000100:00100000:1.0:1788970225.938967:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166272 00000100:00100000:1.0:1788970225.939003:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970225.939011:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8677:x1875871102166272:12345-0@lo:700: 00000100:00100000:1.0:1788970225.939052:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8448:1875871102166400:0@lo:700: 00000100:00100000:1.0:1788970225.939085:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970225.939103:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.939367:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166400 00000100:00100000:2.0:1788970225.939372:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166400 00000100:00100000:2.0:1788970225.939431:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970225.939439:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+6:8448:x1875871102166400:12345-0@lo:700: 00000100:00100000:1.0:1788970225.939678:0:8677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970225.940108:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3649:x1875871102166016:12345-0@lo:400: Request processed in 1941us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.940118:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970225.940137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970225.940145:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102166144:12345-0@lo:400: 00000004:00080000:0.0:1788970225.940303:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788970225.940454:0:8673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8673:1875871102165376:0@lo:502: 00000020:01000000:2.0:1788970225.940902:0:8673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970225.940911:0:8673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.940913:0:8673:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788970225.940919:0:8673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1788970225.940984:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788970225.941007:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788970225.941017:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.941029:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970225.941040:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788970225.941042:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eb0d2c000 from 30 10000000:01000000:2.0:1788970225.941044:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970225.941069:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.941076:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.941085:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.941101:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102166528:0@lo:101: 00000100:00100000:2.0:1788970225.941148:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.941199:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.941218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166528 00000100:00100000:2.0:1788970225.941233:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166528 00000100:00100000:0.0:1788970225.941239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102165632:0@lo:400: 00010000:00080000:0.0:1788970225.941264:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d81a83c00 x1875871102166144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970225.941275:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102166144:0@lo:400: 00000100:00100000:3.0:1788970225.941780:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102166144:12345-0@lo:400: Request processed in 32us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.941790:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970225.942090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970225.942103:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102165760:12345-0@lo:400: 00000100:00100000:3.0:1788970225.942166:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102165760:12345-0@lo:400: Request processed in 67us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.942172:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788970225.942280:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d81a80000 x1875871102165760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970225.942292:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102165760:0@lo:400: 00000100:00100000:2.0:1788970225.942395:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788970225.942404:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102166528:12345-0@lo:101: 00010000:00010000:2.0:1788970225.942429:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970225.942447:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e694 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.942481:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.942499:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.942508:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98200, rc 0) 00000100:00100000:2.0:1788970225.942544:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102166528:12345-0@lo:101: Request processed in 142us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.942550:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788970225.942592:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102166528:0@lo:101: 00010000:00010000:2.0:1788970225.942605:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.942613:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.942672:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102166656:0@lo:501: 00000100:00100000:2.0:1788970225.942700:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.942728:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6acc0 going to sleep for 11 seconds 00000100:00080000:3.0:1788970225.942881:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970225.942887:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970225.942890:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788970225.942919:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d81a81680 x1875871102165504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970225.942931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102165504:0@lo:400: 00010000:00080000:3.0:1788970225.942944:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d81a81e00 x1875871102166016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970225.942953:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102166016:0@lo:400: 00000100:00100000:3.0:1788970225.942965:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102165888:0@lo:400: 00000100:00100000:0.0:1788970225.943111:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166656 00000100:00100000:0.0:1788970225.943119:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166656 00000100:00100000:0.0:1788970225.943157:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788970225.943164:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102166656:12345-0@lo:501: 00000100:00100000:0.0:1788970225.943301:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102166656:12345-0@lo:501: Request processed in 137us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970225.943308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788970225.945738:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102166656:0@lo:501: 00000100:00100000:3.0:1788970225.945803:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102166784:0@lo:503: 00000100:00100000:3.0:1788970225.945864:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.945900:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.947415:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166784 00000100:00100000:2.0:1788970225.947429:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166784 00000100:00100000:3.0:1788970225.947644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788970225.947655:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102166784:12345-0@lo:503: 00000100:00100000:3.0:1788970225.947808:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102166784:12345-0@lo:503: Request processed in 154us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.947816:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788970225.947927:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102166784:0@lo:503: 00000100:00100000:2.0:1788970225.948756:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8679:1875871102166912:0@lo:502: 00000100:00100000:2.0:1788970225.949601:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.949662:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970225.949703:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102166912 00000100:00100000:3.0:1788970225.949711:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102166912 00000100:00100000:3.0:1788970225.949763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970225.949773:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8679:x1875871102166912:12345-0@lo:502: 00000100:00100000:3.0:1788970225.949892:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8679:x1875871102166912:12345-0@lo:502: Request processed in 120us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.949899:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788970225.950031:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8679:1875871102166912:0@lo:502: 00000100:00100000:2.0:1788970225.950088:0:8679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8679:1875871102167040:0@lo:502: 00000100:00100000:2.0:1788970225.950129:0:8679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.950148:0:8679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970225.951771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167040 00000100:00100000:1.0:1788970225.951785:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167040 00000100:00100000:1.0:1788970225.951847:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788970225.951857:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8679:x1875871102167040:12345-0@lo:502: 00000100:00100000:1.0:1788970225.952004:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:8679:x1875871102167040:12345-0@lo:502: Request processed in 149us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970225.952012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788970225.952136:0:8679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8679:1875871102167040:0@lo:502: 00000040:00080000:2.0:1788970225.952167:0:8679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788970225.952480:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788970225.952514:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970225.952553:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970225.952566:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970225.952577:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788970225.952580:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7eb0d2c000 from 5 10000000:01000000:1.0:1788970225.952583:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970225.952616:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970225.952625:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970225.952637:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970225.952664:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167168:0@lo:101: 00000100:00100000:1.0:1788970225.952703:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970225.952735:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970225.954087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167168 00000100:00100000:3.0:1788970225.954098:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167168 00000100:00100000:3.0:1788970225.954150:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788970225.954159:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102167168:12345-0@lo:101: 00010000:00010000:3.0:1788970225.954173:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970225.954198:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e6a2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954221:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954232:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954252:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b800, rc 0) 00000100:00100000:3.0:1788970225.954307:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102167168:12345-0@lo:101: Request processed in 149us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.954313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788970225.954356:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167168:0@lo:101: 00010000:00010000:3.0:1788970225.954372:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954395:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970225.954451:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167296:0@lo:256: 00000100:00100000:3.0:1788970225.954500:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.954525:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970225.954537:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167296 00000100:00100000:3.0:1788970225.954540:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167296 00000100:00100000:3.0:1788970225.954560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788970225.954566:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102167296:12345-0@lo:256: 40000000:02000000:1.0:1788970225.954580:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 20000000:01000000:3.0:1788970225.954581:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970225.954599:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970225.954605:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788970225.954678:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102167296:12345-0@lo:256: Request processed in 111us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.954685:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788970225.954716:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167296:0@lo:256: 10000000:01000000:3.0:1788970225.954753:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970225.954764:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954772:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970225.954780:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788970225.954783:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788970225.954786:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788970225.954802:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954810:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.954819:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970225.954830:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167424:0@lo:101: 00000100:00100000:3.0:1788970225.954853:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970225.954865:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970225.954876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167424 00000100:00100000:3.0:1788970225.954880:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167424 00000100:00100000:3.0:1788970225.954899:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788970225.954905:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102167424:12345-0@lo:101: 00010000:00010000:3.0:1788970225.954911:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970225.955644:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e6b0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.955666:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.955683:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970225.955690:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b000, rc 0) 00000100:00100000:3.0:1788970225.955777:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102167424:12345-0@lo:101: Request processed in 871us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970225.955784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788970225.965047:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8448:x1875871102166400:12345-0@lo:700: Request processed in 25602us (25953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970225.965067:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970225.965099:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167424:0@lo:101: 00010000:00010000:2.0:1788970225.965125:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970225.965139:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970225.965228:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167552:0@lo:501: 00000100:00100000:2.0:1788970225.965268:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.965323:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970225.965626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167552 00000100:00100000:1.0:1788970225.965634:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167552 00000100:00100000:1.0:1788970225.965670:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788970225.965677:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102167552:12345-0@lo:501: 00000100:00100000:1.0:1788970225.965799:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102167552:12345-0@lo:501: Request processed in 123us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970225.965806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788970225.968215:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167552:0@lo:501: 00000100:00100000:2.0:1788970225.968270:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167680:0@lo:503: 00000100:00100000:2.0:1788970225.968339:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970225.968378:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.968427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167680 00000100:00100000:2.0:1788970225.968441:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167680 00000100:00100000:2.0:1788970225.968501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788970225.968509:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102167680:12345-0@lo:503: 00000100:00100000:2.0:1788970225.968617:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102167680:12345-0@lo:503: Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.968625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788970225.968673:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102167680:0@lo:503: 00010000:00080000:0.0:1788970225.968972:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e8949f0c0 x1875871102166400/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788970241 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970225.968987:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8448:1875871102166400:0@lo:700: 40000000:02000000:0.0:1788970225.968997:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1788970225.974991:0:8683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8683:1875871102167808:0@lo:502: 00000100:00100000:1.0:1788970225.975079:0:8683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970225.975136:0:8683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.975202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167808 00000100:00100000:2.0:1788970225.975210:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167808 00000100:00100000:2.0:1788970225.975263:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788970225.975274:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:8683:x1875871102167808:12345-0@lo:502: 00000100:00100000:2.0:1788970225.975439:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:8683:x1875871102167808:12345-0@lo:502: Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.975447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788970225.975527:0:8683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8683:1875871102167808:0@lo:502: 00000020:01000000:2.0:1788970225.975559:0:8683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970225.975566:0:8683:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788970225.975573:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.975576:0:8683:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788970225.975582:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788970225.975587:0:8683:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1788970225.975609:0:8683:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788970225.975612:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970225.975628:0:8683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a7d81aeb380) 00000020:00000080:2.0:1788970225.975652:0:8683:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788970225.975658:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788970225.975737:0:8683:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788970225.975744:0:8683:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788970225.975757:0:8683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e6c5 00010000:00080000:2.0:1788970225.975786:0:8683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d824ff000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970225.976019:0:8683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1788970225.987723:0:8683:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788970225.987748:0:8683:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788970225.988023:0:8683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970225.988209:0:8683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00100000:3.0:1788970225.989995:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:2.0:1788970225.990031:0:8683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788970225.990147:0:8683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1788970225.991695:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8677:x1875871102166272:12345-0@lo:700: Request processed in 52677us (53237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.991725:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788970225.991914:0:8677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e8949c000 x1875871102166272/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788970241 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970225.991930:0:8677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102166272:0@lo:700: 00000040:00080000:3.0:1788970225.992567:0:8686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970225.992574:0:8686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788970225.996177:0:8683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970225.996192:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788970225.996244:0:8683:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788970225.997066:0:8683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e6cc 00000100:00080000:2.0:1788970225.997077:0:8683:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970225.997087:0:8683:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7d824ff000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970225.997121:0:8683:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7eaeef0b40 x1875871102167936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970225.997149:0:8683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788970225.997210:0:8683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970225.997214:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.997216:0:8683:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788970225.997219:0:8683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970225.997222:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.997224:0:8683:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970225.997226:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970225.997228:0:8683:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788970225.997333:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102167936:0@lo:8: 00000100:00100000:0.0:1788970225.997434:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970225.997501:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102167936 00000100:00100000:0.0:1788970225.997508:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102167936 00000100:00100000:0.0:1788970225.997539:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970225.997547:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875871102167936:12345-0@lo:8: 00010000:00080000:0.0:1788970225.997572:0:8442:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788970225.997596:0:8442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e6d3 00002000:00100000:0.0:1788970225.997608:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a7d81ac8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788970225.997612:0:8442:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788970225.997624:0:8442:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970225.997699:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970225.997721:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8a7d81acb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970225.997767:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102167936:12345-0@lo:8: Request processed in 219us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970225.997774:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788970225.997813:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaeef0b40 x1875871102167936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970225.997824:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970225.997831:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788970225.997837:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970225.997842:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788970225.997844:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d824ff000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970225.997854:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970225.997859:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102167936:0@lo:8: 00000100:00100000:2.0:1788970225.997908:0:8683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8683:1875871102168064:0@lo:502: 00000004:00080000:0.0:1788970225.997933:0:8686:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788970225.997960:0:8683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788970225.997986:0:8686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245264603279ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788970225.997989:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168064 00080000:00080000:0.0:1788970225.997994:0:8686:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788970225.997995:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168064 00000100:00100000:2.0:1788970225.998026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788970225.998034:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:8683:x1875871102168064:12345-0@lo:502: 00000100:00100000:2.0:1788970225.998119:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:8683:x1875871102168064:12345-0@lo:502: Request processed in 86us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970225.998125:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788970225.998162:0:8683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970225.998173:0:8683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:8683:1875871102168064:0@lo:502: 00000020:01000000:2.0:1788970225.998191:0:8683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970225.998196:0:8683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970225.998197:0:8683:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788970225.998201:0:8683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788970226.000633:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788970226.000690:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788970226.000749:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970226.000762:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970226.000773:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788970226.000776:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7e848519c0 from 1 10000000:01000000:2.0:1788970226.000779:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788970226.001316:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970226.001327:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970226.001346:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970226.001371:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102168192:0@lo:101: 00000100:00100000:2.0:1788970226.001593:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970226.001629:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.001935:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168192 00000100:00100000:1.0:1788970226.001942:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168192 00000100:00100000:1.0:1788970226.001991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788970226.002000:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102168192:12345-0@lo:101: 00010000:00010000:1.0:1788970226.002013:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970226.002031:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e6da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970226.002056:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970226.002068:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970226.002076:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4e00, rc 0) 00000100:00100000:1.0:1788970226.002130:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102168192:12345-0@lo:101: Request processed in 131us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970226.002137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788970226.002422:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102168192:0@lo:101: 00010000:00010000:3.0:1788970226.002438:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970226.002447:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970226.002521:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102168320:0@lo:501: 00000100:00100000:3.0:1788970226.002550:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970226.002569:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e883dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970226.002585:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168320 00000100:00100000:3.0:1788970226.002589:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168320 00000100:00100000:3.0:1788970226.002613:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788970226.002620:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102168320:12345-0@lo:501: 00000100:00100000:3.0:1788970226.002698:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102168320:12345-0@lo:501: Request processed in 78us (147us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970226.002715:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788970226.002740:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102168320:0@lo:501: 10000000:01000000:2.0:1788970226.002767:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788970226.002774:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970226.002781:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970226.003233:0:8677:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788970226.003277:0:8677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102168576:0@lo:7: 00000100:00100000:1.0:1788970226.003308:0:8677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970226.003337:0:8677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.003358:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168576 00000100:00100000:1.0:1788970226.003361:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168576 00000100:00100000:1.0:1788970226.003426:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970226.003434:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8677:x1875871102168576:12345-0@lo:7: 00000100:00100000:2.0:1788970226.006540:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970226.006565:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102168448:0@lo:13: 00000100:00100000:2.0:1788970226.006642:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970226.007013:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168448 00000100:00100000:0.0:1788970226.007024:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168448 00000100:00100000:0.0:1788970226.007082:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970226.007093:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102168448:12345-0@lo:13: 00002000:00000024:0.0:1788970226.007123:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923832832 avail 3692310528 00000100:00100000:0.0:1788970226.007255:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102168448:12345-0@lo:13: Request processed in 89us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970226.007263:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788970226.007576:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788970226.007653:0:8687:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788970226.007683:0:8687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102168832:0@lo:7: 00010000:00080000:2.0:1788970226.007686:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e93593840 x1875871102168448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970226.007706:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102168448:0@lo:13: 00000100:00100000:0.0:1788970226.007717:0:8687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970226.007737:0:8687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970226.007753:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788970226.007759:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788970226.008002:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168832 00000100:00100000:0.0:1788970226.008007:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168832 00000100:00100000:2.0:1788970226.008227:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970226.008236:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8687:x1875871102168832:12345-0@lo:7: 00000100:00100000:3.0:1788970226.008576:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102168704:0@lo:13: 00000100:00100000:3.0:1788970226.008620:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970226.008659:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970226.009010:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168704 00000100:00100000:0.0:1788970226.009018:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168704 00000100:00100000:0.0:1788970226.009047:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970226.009055:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102168704:12345-0@lo:13: 00002000:00000024:0.0:1788970226.009071:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923832832 avail 3692310528 00000100:00100000:0.0:1788970226.009123:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102168704:12345-0@lo:13: Request processed in 68us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970226.009129:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788970226.010429:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaee42580 x1875871102168704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970226.010452:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102168704:0@lo:13: 00002000:00080000:1.0:1788970226.019943:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788970226.019953:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788970226.020050:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8677:x1875871102168576:12345-0@lo:7: Request processed in 16613us (16737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970226.020061:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788970226.020119:0:8677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf375680 x1875871102168576/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970226.020134:0:8677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102168576:0@lo:7: 00000004:00080000:1.0:1788970226.020156:0:8677:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788970226.020195:0:8677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102168960:0@lo:5: 00000100:00100000:1.0:1788970226.020227:0:8677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970226.021488:0:8677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.021664:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102168960 00000100:00100000:1.0:1788970226.021674:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102168960 00000100:00100000:1.0:1788970226.021736:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970226.021748:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8677:x1875871102168960:12345-0@lo:5: 00002000:00080000:1.0:1788970226.021779:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788970226.022715:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8677:x1875871102168960:12345-0@lo:5: Request processed in 968us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970226.022725:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788970226.022778:0:8677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf375680 x1875871102168960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970226.022792:0:8677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102168960:0@lo:5: 00000004:00080000:1.0:1788970226.022807:0:8677:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788970226.023752:0:8677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102169088:0@lo:5: 00000100:00100000:1.0:1788970226.023800:0:8677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970226.024107:0:8677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.024127:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169088 00000100:00100000:1.0:1788970226.024132:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169088 00002000:00080000:0.0:1788970226.027030:0:8689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788970226.027039:0:8689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788970226.027115:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8687:x1875871102168832:12345-0@lo:7: Request processed in 18877us (19396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970226.027125:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788970226.027175:0:8687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaee42940 x1875871102168832/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970226.027200:0:8687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102168832:0@lo:7: 00000004:00080000:0.0:1788970226.027213:0:8687:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788970226.027254:0:8687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102169216:0@lo:5: 00000100:00100000:0.0:1788970226.027285:0:8687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970226.033218:0:8687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970226.038353:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169216 00000100:00100000:3.0:1788970226.038368:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169216 00000100:00100000:3.0:1788970226.038452:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970226.038473:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8677:x1875871102169088:12345-0@lo:5: 00002000:00080000:3.0:1788970226.038587:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788970226.040376:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970226.040403:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8687:x1875871102169216:12345-0@lo:5: 00002000:00080000:1.0:1788970226.040926:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788970226.040929:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788970226.049191:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8677:x1875871102169088:12345-0@lo:5: Request processed in 10713us (25384us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788970226.049204:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788970226.055145:0:8677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf375680 x1875871102169088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970226.055258:0:8677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8677:1875871102169088:0@lo:5: 00000004:00080000:0.0:1788970226.055275:0:8677:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788970226.055317:0:8677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8677:1875871102169344:0@lo:900: 00000100:00100000:0.0:1788970226.055631:0:8677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970226.055691:0:8677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.057728:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169344 00000100:00100000:1.0:1788970226.057748:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169344 00000100:00100000:1.0:1788970226.057809:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970226.058933:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8677:x1875871102169344:12345-0@lo:900: 00000100:00100000:1.0:1788970226.059052:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8677:x1875871102169344:12345-0@lo:900: Request processed in 1234us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970226.059060:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788970226.059117:0:8677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaee412c0 x1875871102169344/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970226.059132:0:8677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8677:1875871102169344:0@lo:900: 00000001:00080000:1.0:1788970226.066467:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1788970226.066483:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788970226.066628:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788970226.066780:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8687:x1875871102169216:12345-0@lo:5: Request processed in 26378us (39488us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788970226.066791:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788970226.083995:0:8687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaee42940 x1875871102169216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970226.084011:0:8687:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788970226.084018:0:8687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102169216:0@lo:5: 00000004:00080000:0.0:1788970226.084035:0:8687:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788970226.084092:0:8687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102169472:0@lo:700: 00000100:00100000:0.0:1788970226.084151:0:8687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970226.084198:0:8687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.084286:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169472 00000100:00100000:1.0:1788970226.084293:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169472 00000100:00100000:1.0:1788970226.084346:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970226.084364:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8687:x1875871102169472:12345-0@lo:700: 00000100:00100000:1.0:1788970226.100101:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8687:x1875871102169472:12345-0@lo:700: Request processed in 15740us (15942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970226.100116:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788970226.100175:0:8687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaee42940 x1875871102169472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970226.100190:0:8687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102169472:0@lo:700: 00000004:02000040:2.0:1788970226.102173:0:8687:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788970226.109613:0:8687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102169600:0@lo:5: 00000100:00100000:0.0:1788970226.109676:0:8687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970226.109714:0:8687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970226.110410:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169600 00000100:00100000:1.0:1788970226.110430:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169600 00000100:00100000:1.0:1788970226.110605:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970226.110616:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8687:x1875871102169600:12345-0@lo:5: 00002000:00080000:1.0:1788970226.118800:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788970226.118897:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788970226.126186:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8687:x1875871102169600:12345-0@lo:5: Request processed in 15566us (16503us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788970226.126199:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788970226.126857:0:8687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaee43c00 x1875871102169600/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970226.126875:0:8687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8687:1875871102169600:0@lo:5: 00000004:00080000:1.0:1788970226.126890:0:8687:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788970226.720900:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970226.973853:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102169728:0@lo:41: 00000100:00100000:0.0:1788970226.973918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970226.976890:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169728 00000100:00100000:1.0:1788970226.976907:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169728 00000100:00100000:1.0:1788970226.976978:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970226.976989:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102169728:12345-0@lo:41: 00000004:00000024:1.0:1788970226.977026:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788970226.982658:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102169728:12345-0@lo:41: Request processed in 5659us (8727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970226.982672:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970226.986122:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102169728:0@lo:41: 00010000:00010000:1.0:1788970227.743064:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970228.267822:0:8816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788970228.508512:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970228.508539:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102169856:0@lo:41: 00000100:00100000:0.0:1788970228.508780:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970228.509619:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169856 00000100:00100000:2.0:1788970228.509632:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169856 00000100:00100000:2.0:1788970228.509699:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970228.509710:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102169856:12345-0@lo:41: 00000004:00000024:2.0:1788970228.509754:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788970228.509827:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102169856:12345-0@lo:41: Request processed in 118us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970228.509834:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970228.510712:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102169856:0@lo:41: 00010000:00010000:2.0:1788970228.767795:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788970229.223490:0:8868:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970229.223669:0:8868:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970229.791273:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788970230.027073:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788970230.812594:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970231.069721:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102170368:0@lo:400: 00000100:00100000:3.0:1788970231.070077:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102169984:0@lo:400: 00000100:00100000:3.0:1788970231.070113:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970231.070153:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102170496:0@lo:400: 00000100:00100000:3.0:1788970231.070178:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970231.070581:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102171008:0@lo:400: 00000100:00100000:3.0:1788970231.070606:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970231.070648:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171008 00000100:00100000:3.0:1788970231.070656:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171008 00000100:00100000:2.0:1788970231.072707:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102169984 00000100:00100000:2.0:1788970231.072721:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102169984 00000100:00100000:0.0:1788970231.072732:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970231.072773:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788970231.072782:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3652:x1875871102169984:12345-0@lo:400: 00000100:00100000:2.0:1788970231.072874:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3652:x1875871102169984:12345-0@lo:400: Request processed in 92us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970231.072881:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788970231.072952:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102170880:0@lo:400: 00000100:00080000:2.0:1788970231.072955:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970231.072990:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102169984:0@lo:400: 00000100:00100000:2.0:1788970231.073056:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170496 00000100:00100000:2.0:1788970231.073060:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170496 00000100:00100000:2.0:1788970231.073085:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970231.073090:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102170496:12345-0@lo:400: 00000100:00100000:2.0:1788970231.073126:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102170496:12345-0@lo:400: Request processed in 35us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970231.073149:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970231.073170:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102170112:0@lo:400: 00000100:00100000:3.0:1788970231.073205:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970231.073206:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970231.073223:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102171008:12345-0@lo:400: 00000100:00100000:2.0:1788970231.073232:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102170624:0@lo:400: 00000100:00100000:2.0:1788970231.073262:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970231.073282:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102171008:12345-0@lo:400: Request processed in 64us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970231.073287:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102171136:0@lo:13: 00000100:00100000:3.0:1788970231.073293:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970231.073315:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970231.073350:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102170496:0@lo:400: 00010000:00080000:3.0:1788970231.073365:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58ded00 x1875871102171008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970231.073374:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788970231.073405:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102171008:0@lo:400: 00000100:00100000:3.0:1788970231.073450:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170368 00000100:00100000:3.0:1788970231.073455:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170368 00000100:00100000:3.0:1788970231.073475:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170112 00000100:00100000:0.0:1788970231.073587:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970231.073621:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102170240:0@lo:400: 00000100:00100000:0.0:1788970231.073650:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970231.073668:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102170752:0@lo:400: 00000100:00100000:0.0:1788970231.073688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970231.073698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102171264:0@lo:13: 00000100:00100000:0.0:1788970231.073723:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170624 00000100:00100000:0.0:1788970231.073727:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170624 00000100:00100000:0.0:1788970231.073751:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170752 00000100:00100000:0.0:1788970231.073754:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170752 00000100:00100000:0.0:1788970231.073768:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970231.073774:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102170368:12345-0@lo:400: 00000100:00100000:0.0:1788970231.074289:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102170368:12345-0@lo:400: Request processed in 512us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970231.074297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970231.074315:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970231.074322:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102170624:12345-0@lo:400: 00000100:00100000:0.0:1788970231.074351:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102170624:12345-0@lo:400: Request processed in 30us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970231.074356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970231.074369:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970231.074375:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102170752:12345-0@lo:400: 00010000:00080000:2.0:1788970231.075232:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58df480 x1875871102170624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970231.075247:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102170624:0@lo:400: 00000100:00080000:2.0:1788970231.075283:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970231.075288:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970231.075301:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970231.075557:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102170752:12345-0@lo:400: Request processed in 1181us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970231.075565:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970231.075589:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170240 00000100:00100000:0.0:1788970231.075594:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170240 00000100:00100000:0.0:1788970231.075621:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970231.075628:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102170240:12345-0@lo:400: 00000100:00100000:0.0:1788970231.075661:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102170240:12345-0@lo:400: Request processed in 33us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970231.075666:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970231.075682:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171136 00000100:00100000:0.0:1788970231.075686:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171136 00000100:00100000:2.0:1788970231.075693:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102170880 00000100:00100000:2.0:1788970231.075700:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170880 00000100:00100000:0.0:1788970231.075702:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171264 00000100:00100000:0.0:1788970231.075708:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171264 00000100:00100000:0.0:1788970231.075724:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970231.075733:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102171136:12345-0@lo:13: 00000100:00100000:2.0:1788970231.075751:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00002000:00000024:0.0:1788970231.075757:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970231.075762:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102170880:12345-0@lo:400: 00000100:00100000:0.0:1788970231.075804:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102171136:12345-0@lo:13: Request processed in 72us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970231.075810:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970231.075816:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102170880:12345-0@lo:400: Request processed in 54us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970231.075825:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970231.075829:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970231.075837:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102171264:12345-0@lo:13: 00002000:00000024:0.0:1788970231.075847:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970231.075876:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102171264:12345-0@lo:13: Request processed in 40us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970231.075878:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102170240:0@lo:400: 00000100:00100000:0.0:1788970231.075887:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788970231.075903:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dfc00 x1875871102170752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970231.075913:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102170752:0@lo:400: 00010000:00080000:0.0:1788970231.075922:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ea1f2d2c0 x1875871102170368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788970231.075929:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf375e00 x1875871102171264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970231.075952:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788970231.075968:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102170368:0@lo:400: 00000100:00100000:2.0:1788970231.075971:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102171264:0@lo:13: 00010000:00080000:0.0:1788970231.075991:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dcf00 x1875871102170880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970231.076002:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102170880:0@lo:400: 00000100:00080000:2.0:1788970231.076003:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970231.076029:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaeef0000 x1875871102171136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970231.076042:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102171136:0@lo:13: 00000100:00100000:3.0:1788970231.076513:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102170112 00000100:00100000:3.0:1788970231.076561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788970231.076569:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102170112:12345-0@lo:400: 00000100:00100000:3.0:1788970231.076613:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102170112:12345-0@lo:400: Request processed in 45us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970231.076620:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788970231.081072:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e8949da40 x1875871102170112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970231.081092:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102170112:0@lo:400: 00010000:00010000:1.0:1788970231.837876:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970231.916052:0:8969:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970231.917001:0:8969:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788970232.093099:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102171392:0@lo:41: 00000100:00100000:0.0:1788970232.093165:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970232.093235:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171392 00000100:00100000:3.0:1788970232.093251:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171392 00000100:00100000:3.0:1788970232.093329:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970232.093342:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102171392:12345-0@lo:41: 00000004:00000024:3.0:1788970232.093431:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788970232.093530:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102171392:12345-0@lo:41: Request processed in 190us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970232.093538:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970232.094345:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102171392:0@lo:41: 00000020:00000004:3.0:1788970232.859765:0:9017:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970232.859787:0:9017:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788970232.860696:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970233.634767:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102171520:0@lo:41: 00000100:00100000:3.0:1788970233.634868:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970233.634981:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171520 00000100:00100000:2.0:1788970233.634993:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171520 00000100:00100000:2.0:1788970233.635063:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970233.635074:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102171520:12345-0@lo:41: 00000004:00000024:2.0:1788970233.635118:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788970233.644561:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102171520:12345-0@lo:41: Request processed in 9472us (9678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970233.644581:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970233.650685:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102171520:0@lo:41: 00010000:00010000:2.0:1788970233.884791:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970234.913055:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970235.935480:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970236.191925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102171648:0@lo:400: 00000100:00100000:2.0:1788970236.192001:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192064:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102172160:0@lo:400: 00000100:00100000:2.0:1788970236.192121:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192328:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102172672:0@lo:400: 00000100:00100000:2.0:1788970236.192365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192440:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788970236.192451:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102171776:0@lo:400: 00000100:00100000:1.0:1788970236.192458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171648 00000100:00100000:1.0:1788970236.192474:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171648 00000100:00100000:2.0:1788970236.192480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102172288:0@lo:400: 00000100:00100000:1.0:1788970236.192558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788970236.192559:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970236.192580:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3649:x1875871102171648:12345-0@lo:400: 00000100:00100000:2.0:1788970236.192594:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102172800:0@lo:13: 00000100:00100000:2.0:1788970236.192627:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192666:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102172032:0@lo:400: 00000100:00100000:2.0:1788970236.192807:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192834:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102172544:0@lo:400: 00000100:00100000:2.0:1788970236.192855:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192875:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788970236.192881:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102171904:0@lo:400: 00000100:00100000:2.0:1788970236.192901:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192915:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102172416:0@lo:400: 00000100:00100000:2.0:1788970236.192936:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970236.192961:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172160 00000100:00100000:2.0:1788970236.192968:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172160 00000100:00100000:2.0:1788970236.193008:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171904 00000100:00100000:0.0:1788970236.193046:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102172928:0@lo:13: 00000100:00100000:0.0:1788970236.193074:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970236.193108:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102171776 00000100:00100000:0.0:1788970236.193112:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171776 00000100:00100000:0.0:1788970236.193132:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172288 00000100:00100000:0.0:1788970236.193134:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172288 00000100:00100000:0.0:1788970236.193153:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172032 00000100:00100000:0.0:1788970236.193156:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172032 00000100:00100000:0.0:1788970236.193165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172416 00000100:00100000:0.0:1788970236.193167:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172416 00000100:00100000:0.0:1788970236.193181:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970236.193190:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102171776:12345-0@lo:400: 00000100:00100000:0.0:1788970236.193237:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102171776:12345-0@lo:400: Request processed in 49us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970236.193243:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970236.193258:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970236.193264:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102172288:12345-0@lo:400: 00000100:00100000:0.0:1788970236.193302:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102172288:12345-0@lo:400: Request processed in 39us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970236.193307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970236.193318:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788970236.193324:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102172032:12345-0@lo:400: 00000100:00100000:0.0:1788970236.193348:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102172032:12345-0@lo:400: Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970236.193353:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788970236.193364:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970236.193369:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102172416:12345-0@lo:400: 00000100:00100000:0.0:1788970236.193426:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102172416:12345-0@lo:400: Request processed in 56us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970236.193431:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970236.193642:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172800 00000100:00100000:0.0:1788970236.193646:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172800 00000100:00100000:2.0:1788970236.194118:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102171904 00000100:00100000:2.0:1788970236.194217:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970236.194226:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102172160:12345-0@lo:400: 00000100:00100000:2.0:1788970236.194278:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102172160:12345-0@lo:400: Request processed in 54us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970236.194287:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172928 00000100:00100000:0.0:1788970236.194290:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172928 00000100:00100000:2.0:1788970236.194293:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788970236.194305:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970236.194306:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788970236.194310:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102172800:12345-0@lo:13: 00000100:00100000:2.0:1788970236.194311:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102171904:12345-0@lo:400: 00002000:00000024:0.0:1788970236.194331:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970236.194340:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102171904:12345-0@lo:400: Request processed in 29us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970236.194345:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788970236.194368:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172672 00000100:00100000:2.0:1788970236.194372:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172672 00000100:00100000:2.0:1788970236.194417:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102172544 00000100:00100000:2.0:1788970236.194421:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102172544 00000100:00100000:2.0:1788970236.194441:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970236.194447:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102172672:12345-0@lo:400: 00000100:00100000:2.0:1788970236.194478:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102172672:12345-0@lo:400: Request processed in 31us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970236.194483:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970236.196562:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102172800:12345-0@lo:13: Request processed in 234us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970236.196588:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970236.196628:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970236.196643:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102172928:12345-0@lo:13: 00002000:00000024:0.0:1788970236.196673:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970236.196773:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102172928:12345-0@lo:13: Request processed in 137us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970236.196818:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970236.196829:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875871102172544:12345-0@lo:400: 00000100:00100000:2.0:1788970236.196868:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875871102172544:12345-0@lo:400: Request processed in 42us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970236.196874:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788970236.197858:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970236.197867:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970236.197870:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970236.197925:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102171904:0@lo:400: 00010000:00080000:2.0:1788970236.197942:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ea1ea7840 x1875871102172416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970236.197967:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970236.197972:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102172416:0@lo:400: 00010000:00080000:2.0:1788970236.197987:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e93593840 x1875871102172032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970236.197994:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102172032:0@lo:400: 00010000:00080000:2.0:1788970236.198004:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ea1ea5a40 x1875871102172544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788970236.198009:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dd680 x1875871102172928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970236.198026:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102172928:0@lo:13: 00000100:00100000:1.0:1788970236.198537:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3649:x1875871102171648:12345-0@lo:400: Request processed in 5952us (6524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970236.198553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1788970236.198659:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e8949da40 x1875871102171776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970236.198675:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102171776:0@lo:400: 00010000:00080000:1.0:1788970236.198691:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7e898fc780 x1875871102172288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970236.198699:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102172288:0@lo:400: 00010000:00080000:1.0:1788970236.198713:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf374f00 x1875871102172800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970236.198730:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102172800:0@lo:13: 00000100:00100000:1.0:1788970236.198744:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102171648:0@lo:400: 00000100:00100000:1.0:1788970236.198757:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102172160:0@lo:400: 00010000:00080000:1.0:1788970236.198768:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ea1ea6d00 x1875871102172672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970236.198775:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102172672:0@lo:400: 00000100:00100000:2.0:1788970236.198822:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102172544:0@lo:400: 00010000:00010000:0.0:1788970236.956623:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970237.213415:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102173056:0@lo:41: 00000100:00100000:2.0:1788970237.213487:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970237.214037:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173056 00000100:00100000:0.0:1788970237.214047:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173056 00000100:00100000:0.0:1788970237.214100:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788970237.214110:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102173056:12345-0@lo:41: 00000004:00000024:0.0:1788970237.214144:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788970237.214201:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102173056:12345-0@lo:41: Request processed in 93us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970237.214208:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788970237.214257:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102173056:0@lo:41: 00010000:00010000:2.0:1788970237.980508:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970238.755489:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102173184:0@lo:41: 00000100:00100000:0.0:1788970238.755570:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970238.755651:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173184 00000100:00100000:0.0:1788970238.755659:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173184 00000100:00100000:0.0:1788970238.755702:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788970238.755710:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102173184:12345-0@lo:41: 00000004:00000024:0.0:1788970238.755742:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788970238.755786:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102173184:12345-0@lo:41: Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970238.755793:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788970238.755840:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102173184:0@lo:41: 00010000:00010000:1.0:1788970239.007316:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970240.031458:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970241.052555:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970241.311122:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970241.311152:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102173312:0@lo:13: 00000100:00100000:2.0:1788970241.311234:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970241.311366:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173312 00000100:00100000:3.0:1788970241.311375:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173312 00000100:00100000:3.0:1788970241.311447:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970241.311456:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102173312:12345-0@lo:13: 00002000:00000024:3.0:1788970241.311483:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970241.311521:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102173312:12345-0@lo:13: Request processed in 68us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970241.311533:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788970241.311655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970241.311939:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaef2bc00 x1875871102173312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970241.311969:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102173312:0@lo:13: 00000100:00100000:3.0:1788970241.314228:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102173440:0@lo:400: 00000100:00100000:3.0:1788970241.314296:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970241.317111:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173440 00000100:00100000:2.0:1788970241.317125:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173440 00000100:00100000:2.0:1788970241.317178:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788970241.317194:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3651:x1875871102173440:12345-0@lo:400: 00000100:00100000:0.0:1788970241.320358:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102173696:0@lo:400: 00000100:00100000:0.0:1788970241.320447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970241.320479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102174208:0@lo:400: 00000100:00100000:0.0:1788970241.320503:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970241.320525:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788970241.320532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102173824:0@lo:400: 00000100:00100000:2.0:1788970241.320559:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3651:x1875871102173440:12345-0@lo:400: Request processed in 3371us (6260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970241.320667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788970241.323975:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970241.324031:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102174336:0@lo:400: 00000100:00100000:0.0:1788970241.324069:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970241.324105:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173696 00000100:00100000:0.0:1788970241.324113:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173696 00000100:00100000:0.0:1788970241.324160:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970241.324170:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102173696:12345-0@lo:400: 00000100:00100000:3.0:1788970241.324216:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102173440:0@lo:400: 00000100:00100000:3.0:1788970241.324239:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102173952:0@lo:400: 00000100:00100000:3.0:1788970241.324268:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970241.324291:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102174464:0@lo:13: 00000100:00100000:3.0:1788970241.324317:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970241.324335:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788970241.324342:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102173568:0@lo:400: 00000100:00100000:3.0:1788970241.324377:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970241.324415:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102174080:0@lo:400: 00000100:00100000:3.0:1788970241.324437:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970241.324639:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173952 00000100:00100000:3.0:1788970241.324645:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173952 00000100:00100000:3.0:1788970241.324677:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970241.324684:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102173952:12345-0@lo:400: 00000100:00100000:2.0:1788970241.324726:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174208 00000100:00100000:2.0:1788970241.324732:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174208 00000100:00100000:3.0:1788970241.324739:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102173952:12345-0@lo:400: Request processed in 55us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970241.324747:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970241.324767:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173824 00000100:00100000:2.0:1788970241.324770:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173824 00000100:00100000:2.0:1788970241.324783:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102173568 00000100:00100000:2.0:1788970241.324786:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102173568 00000100:00100000:3.0:1788970241.324796:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174464 00000100:00100000:2.0:1788970241.324798:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174080 00000100:00100000:3.0:1788970241.324802:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174464 00000100:00100000:2.0:1788970241.324803:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174080 00000100:00100000:2.0:1788970241.324832:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788970241.324841:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102174208:12345-0@lo:400: 00000100:00100000:3.0:1788970241.324843:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970241.324855:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102174464:12345-0@lo:13: 00002000:00000024:3.0:1788970241.324873:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970241.324894:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102174208:12345-0@lo:400: Request processed in 55us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970241.324902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970241.324915:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102174464:12345-0@lo:13: Request processed in 62us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970241.324921:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970241.324926:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970241.324933:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102173824:12345-0@lo:400: 00000100:00100000:3.0:1788970241.324956:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102173952:0@lo:400: 00010000:00080000:3.0:1788970241.324967:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58ded00 x1875871102174464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970241.324984:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102173824:12345-0@lo:400: Request processed in 55us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970241.324991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970241.325003:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788970241.325008:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102173568:12345-0@lo:400: 00000100:00100000:2.0:1788970241.325039:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102173568:12345-0@lo:400: Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970241.325044:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788970241.325054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970241.325059:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102174080:12345-0@lo:400: 00000100:00100000:2.0:1788970241.325084:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102174080:12345-0@lo:400: Request processed in 25us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970241.325087:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102174464:0@lo:13: 00000100:00100000:2.0:1788970241.325101:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788970241.325112:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dd680 x1875871102173568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788970241.325120:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970241.325123:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102173568:0@lo:400: 00000100:00080000:2.0:1788970241.325126:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970241.325132:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788970241.325207:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dcf00 x1875871102174080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970241.325216:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102174080:0@lo:400: 00000100:00100000:0.0:1788970241.326838:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102173696:12345-0@lo:400: Request processed in 2666us (6386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970241.326849:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970241.326887:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174336 00000100:00100000:0.0:1788970241.326893:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174336 00000100:00100000:0.0:1788970241.326925:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970241.326933:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102174336:12345-0@lo:400: 00000100:00100000:0.0:1788970241.326962:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102174336:12345-0@lo:400: Request processed in 31us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970241.326968:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788970241.327101:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dc000 x1875871102173824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970241.327114:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102173824:0@lo:400: 00010000:00080000:0.0:1788970241.327125:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58df480 x1875871102174336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970241.327148:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102174336:0@lo:400: 00000100:00100000:0.0:1788970241.327162:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102173696:0@lo:400: 00010000:00080000:0.0:1788970241.327171:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eb58dfc00 x1875871102174208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970241.327179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102174208:0@lo:400: 00010000:00010000:0.0:1788970242.077731:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970242.343085:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102174592:0@lo:41: 00000100:00100000:2.0:1788970242.343163:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.343471:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174592 00000100:00100000:0.0:1788970242.343479:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174592 00000100:00100000:2.0:1788970242.343643:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970242.343653:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102174592:12345-0@lo:41: 00000004:00000024:2.0:1788970242.343688:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788970242.343736:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102174592:12345-0@lo:41: Request processed in 85us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.343742:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970242.343792:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102174592:0@lo:41: 00000020:01000004:0.0:1788970242.378600:0:9517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788970242.378604:0:9517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788970242.378618:0:9517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788970242.378720:0:9517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7d81ace000 00000020:01000004:0.0:1788970242.378734:0:9517:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788970242.378746:0:9517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788970242.378759:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a7e8fc80000) 00000020:00000080:0.0:1788970242.378785:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788970242.419892:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788970242.419940:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788970242.439094:0:9517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788970242.440574:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788970242.440589:0:9517:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788970242.440607:0:9517:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3abfebe76c6e6ef 00000020:01000004:1.0:1788970242.440615:0:9517:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788970242.440638:0:9517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788970242.440642:0:9517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788970242.440649:0:9517:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788970242.440679:0:9517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788970242.440683:0:9517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788970242.460615:0:9517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970242.460655:0:9517:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788970242.460664:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970242.460666:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970242.460667:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970242.460668:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970242.460669:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970242.460671:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970242.460672:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970242.460674:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970242.460675:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970242.460676:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970242.460677:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970242.460681:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788970242.460683:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970242.460685:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970242.460686:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970242.460686:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970242.460687:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970242.460688:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970242.460689:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970242.460690:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970242.460691:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970242.460692:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970242.460693:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970242.460718:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788970242.460739:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102174720:0@lo:253: 00000100:00100000:3.0:1788970242.460821:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.460959:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb59540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970242.461061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174720 00000100:00100000:1.0:1788970242.461069:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174720 00000100:00100000:1.0:1788970242.461158:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788970242.461168:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:9517:x1875871102174720:12345-0@lo:253: 20000000:01000000:1.0:1788970242.461222:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788970242.461227:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788970242.461231:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788970242.461234:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788970242.461493:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970242.461632:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788970242.461646:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788970242.461663:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788970242.461668:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788970242.461681:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788970242.461694:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788970242.461782:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788970242.461798:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1788970242.461800:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1788970242.461816:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788970242.461822:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788970242.461837:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788970242.461841:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1788970242.461867:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788970242.461875:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788970242.461896:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788970242.461913:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788970242.461983:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788970242.462007:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1788970242.462009:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1788970242.462023:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788970242.462029:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788970242.462041:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788970242.462046:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1788970242.462058:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788970242.462064:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788970242.462074:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788970242.462089:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788970242.462478:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788970242.462489:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.115@tcp 20000000:01000000:1.0:1788970242.462491:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.115@tcp (null) (null) (null) 00000040:00080000:1.0:1788970242.462503:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788970242.462508:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788970242.462520:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788970242.462524:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.115@tcp (null) (null) 00000040:00080000:1.0:1788970242.462537:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788970242.462542:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788970242.462555:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788970242.462570:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788970242.462583:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788970242.462586:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788970242.462590:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788970242.462631:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788970242.462633:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788970242.463644:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788970242.463683:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788970242.463703:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788970242.463904:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788970242.463923:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788970242.463935:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788970242.463944:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788970242.463946:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788970242.464680:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788970242.464705:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788970242.464722:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788970242.464887:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788970242.464909:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788970242.464926:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788970242.464937:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788970242.464939:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788970242.465941:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788970242.466491:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788970242.466521:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788970242.466538:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788970242.466550:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788970242.466553:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788970242.466830:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788970242.466851:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788970242.466868:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788970242.467089:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788970242.467107:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788970242.467121:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788970242.467244:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788970242.467246:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788970242.467755:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788970242.467777:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788970242.467793:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788970242.467944:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788970242.467965:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788970242.467981:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:3.0:1788970242.468070:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788970242.468090:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.468108:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.468117:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.468125:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.470875:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.470887:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.470895:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.470920:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.471070:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.471114:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.471126:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 21 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.471140:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a803c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102174848:0@lo:104: 00000100:00100000:3.0:1788970242.471203:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.471283:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174848 00000100:00100000:2.0:1788970242.471293:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174848 00010000:00010000:3.0:1788970242.471334:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.471354:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 21 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.471363:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102174976:0@lo:104: 00000100:00100000:2.0:1788970242.471370:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970242.471411:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102174848:12345-0@lo:104: 00010000:00010000:2.0:1788970242.471424:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.471465:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970242.471496:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970242.471504:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102174848:12345-0@lo:104: Request processed in 124us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970242.471509:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.471515:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788970242.471523:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.471534:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102175104:0@lo:104: 00000100:00100000:2.0:1788970242.471536:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102174976 00000100:00100000:2.0:1788970242.471541:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102174976 00010000:00010000:0.0:1788970242.471551:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.471559:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.471561:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788970242.471569:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.471573:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.471578:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.471579:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102174976:12345-0@lo:104: 00010000:00010000:0.0:1788970242.471587:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.471588:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.471605:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.471609:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.471613:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970242.471624:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 21 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.471629:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970242.471635:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102175232:0@lo:104: 00000100:00100000:2.0:1788970242.471636:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102174976:12345-0@lo:104: Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.471645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788970242.471650:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.471655:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175104 00010000:00010000:0.0:1788970242.471656:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788970242.471658:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175104 00000100:00100000:2.0:1788970242.471675:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970242.471681:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102175104:12345-0@lo:104: 00010000:00010000:0.0:1788970242.471681:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.471692:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471692:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c6e6da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471706:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.471709:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471715:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.471718:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.471720:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970242.471725:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102175104:12345-0@lo:104: Request processed in 44us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1788970242.471725:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.471731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 10000000:00010000:0.0:1788970242.471732:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.471737:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970242.471756:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471762:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788970242.471764:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970242.471769:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471777:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b600/0xc3abfebe76c6e6b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471787:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.471790:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471795:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.471798:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471805:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.471810:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.471815:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970242.471832:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471839:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970242.471852:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.471869:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98800/0xc3abfebe76c6e694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e69b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.471880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d825483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102175488:0@lo:103: 00010000:00010000:0.0:1788970242.471880:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.471883:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.471886:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.471895:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970242.471907:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102175360:0@lo:103: 00000100:00100000:3.0:1788970242.471914:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.471953:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175232 00000100:00100000:2.0:1788970242.471958:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175232 00000100:00100000:2.0:1788970242.471986:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970242.471993:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102175232:12345-0@lo:104: 00010000:00010000:2.0:1788970242.472000:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.472059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175488 00000100:00100000:3.0:1788970242.472063:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175488 00010000:00010000:3.0:1788970242.472080:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 22 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.472107:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970242.472114:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3650:x1875871102175488:12345-0@lo:103: 00010000:00010000:3.0:1788970242.472123:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970242.472129:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 22 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.472137:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 22 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.472151:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970242.472439:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102175616:0@lo:103: 00000100:00100000:0.0:1788970242.473074:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.473130:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175360 00000100:00100000:0.0:1788970242.473148:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175360 00010000:00010000:0.0:1788970242.473576:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 23 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.473609:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970242.473617:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3649:x1875871102175360:12345-0@lo:103: 00010000:00010000:0.0:1788970242.473628:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.473633:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 23 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.473645:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 23 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.473660:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970242.473700:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3649:x1875871102175360:12345-0@lo:103: Request processed in 84us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.473707:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970242.473745:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102175360:0@lo:103: 00010000:00010000:2.0:1788970242.475917:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970242.475931:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102175232:12345-0@lo:104: Request processed in 3936us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.475956:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788970242.476021:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.476030:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.476040:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.476045:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.476055:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.476063:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.476068:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3650:x1875871102175488:12345-0@lo:103: Request processed in 3952us (4151us total) trans 0 rc 0/0 10000000:01000000:0.0:1788970242.476071:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788970242.476083:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788970242.476120:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.476138:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970242.476160:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.476162:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.476179:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99a00/0xc3abfebe76c6e66a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e671 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.476184:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 21 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.476195:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970242.476201:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102175872:0@lo:104: 00010000:00010000:0.0:1788970242.476210:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.476213:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970242.476227:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102175744:0@lo:103: 00000100:00100000:3.0:1788970242.476254:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.476263:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970242.476293:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.476302:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 21 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.476311:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102176000:0@lo:104: 00000100:00100000:3.0:1788970242.476335:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.476444:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d825483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102175488:0@lo:103: 00010000:00010000:3.0:1788970242.476523:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.476532:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 21 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.476540:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102176128:0@lo:104: 00000100:00100000:3.0:1788970242.476562:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788970242.476578:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4e00/0xc3abfebe76c6e6e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e6da expref: 21 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.476589:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a803c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102174848:0@lo:104: 00010000:00010000:3.0:1788970242.476599:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e6b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e6b0 expref: 20 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.476618:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102174976:0@lo:104: 00000100:00100000:3.0:1788970242.476628:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102175104:0@lo:104: 00000100:00100000:3.0:1788970242.476634:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102175232:0@lo:104: 00000100:00100000:3.0:1788970242.476658:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788970242.476675:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.476686:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175872 00000100:00100000:3.0:1788970242.476704:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175872 00000100:00100000:3.0:1788970242.476734:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176000 00000100:00100000:3.0:1788970242.476737:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176000 00000100:00100000:3.0:1788970242.476745:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176128 00000100:00100000:3.0:1788970242.476747:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176128 00000100:00100000:3.0:1788970242.476759:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970242.476766:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6518:x1875871102175872:12345-0@lo:104: 00010000:00010000:3.0:1788970242.476776:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.476971:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970242.476977:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:6518:x1875871102175872:12345-0@lo:104: Request processed in 211us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970242.476984:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970242.476999:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788970242.477005:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebd691850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6518:x1875871102176000:12345-0@lo:104: 00010000:00010000:3.0:1788970242.477012:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.477045:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788970242.477055:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788970242.477056:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebd691850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6518:x1875871102176000:12345-0@lo:104: Request processed in 51us (719us total) trans 0 rc 0/0 00010000:00010000:0.0:1788970242.477063:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.477066:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788970242.477075:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.477079:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477088:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.477096:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.477100:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 10000000:01000000:0.0:1788970242.477107:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788970242.477112:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102176128:12345-0@lo:104: 00010000:00010000:3.0:1788970242.477122:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477143:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477243:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970242.477260:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477267:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c6e64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e655 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477279:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.477282:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477289:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e80031a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.477292:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477306:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.477312:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.477318:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788970242.477448:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970242.477585:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477592:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970242.477598:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477605:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e80031a00/0xc3abfebe76c6e60f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e616 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.477615:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.477617:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.477618:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970242.477636:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102176384:0@lo:103: 00000100:00100000:0.0:1788970242.477665:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.477685:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970242.477690:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102176256:0@lo:103: 00000100:00100000:0.0:1788970242.477711:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.477735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175744 00000100:00100000:0.0:1788970242.477741:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175744 00010000:00010000:0.0:1788970242.477770:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 20 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.478296:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102175616 00000100:00100000:0.0:1788970242.478301:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102175616 00010000:00010000:0.0:1788970242.478327:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.478350:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176384 00000100:00100000:0.0:1788970242.478352:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176384 00010000:00010000:0.0:1788970242.478365:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 22 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.478374:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176256 00000100:00100000:0.0:1788970242.478377:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176256 00010000:00010000:0.0:1788970242.478410:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 23 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.478423:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970242.478431:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3652:x1875871102175744:12345-0@lo:103: 00010000:00010000:0.0:1788970242.478442:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.478446:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 23 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478455:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 23 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.478457:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102175872:0@lo:104: 00000100:00100000:2.0:1788970242.478467:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102176000:0@lo:104: 00010000:00010000:0.0:1788970242.478470:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99e00/0xc3abfebe76c6e671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e66a expref: 23 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478484:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970242.478536:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3652:x1875871102175744:12345-0@lo:103: Request processed in 105us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.478553:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970242.478557:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102175744:0@lo:103: 00000100:00100000:0.0:1788970242.478569:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970242.478575:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3651:x1875871102175616:12345-0@lo:103: 00010000:00010000:0.0:1788970242.478583:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.478588:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478597:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478608:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e69b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e694 expref: 21 pid: 6517 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478618:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970242.478654:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:3651:x1875871102175616:12345-0@lo:103: Request processed in 79us (1206us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970242.478655:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970242.478666:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788970242.478667:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6518:x1875871102176128:12345-0@lo:104: Request processed in 1555us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970242.478677:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970242.478704:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970242.478711:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3650:x1875871102176384:12345-0@lo:103: 00010000:00010000:0.0:1788970242.478718:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.478721:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 19 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478730:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 19 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478739:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e60f expref: 19 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478760:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970242.478772:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970242.478779:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.478788:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98e00 already unused, calling callback (ffffffffc116cc20) 00000100:00100000:0.0:1788970242.478790:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3650:x1875871102176384:12345-0@lo:103: Request processed in 79us (1124us total) trans 0 rc 0/0 10000000:00010000:3.0:1788970242.478794:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.478800:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970242.478814:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970242.478820:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:3650:x1875871102176256:12345-0@lo:103: 00010000:00010000:0.0:1788970242.478827:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.478831:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 17 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478839:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 17 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478847:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6e655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e64e expref: 17 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.478856:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970242.478878:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3650:x1875871102176256:12345-0@lo:103: Request processed in 57us (1165us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970242.478882:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.478884:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:00010000:3.0:1788970242.478894:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970242.478900:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788970242.478915:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102176256:0@lo:103: 00000100:00100000:0.0:1788970242.478924:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102176384:0@lo:103: 00010000:00010000:3.0:1788970242.479012:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479029:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970242.479049:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479056:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e5e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5ec expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479070:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970242.479072:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970242.479073:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970242.479087:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970242.479110:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875871102176128:0@lo:104: 00000100:00100000:0.0:1788970242.479134:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788970242.479144:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.479207:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102176512:0@lo:103: 00000100:00100000:0.0:1788970242.479240:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.479322:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176512 00000100:00100000:3.0:1788970242.479327:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176512 00010000:00010000:3.0:1788970242.479353:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.479377:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970242.479402:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3652:x1875871102176512:12345-0@lo:103: 00010000:00010000:3.0:1788970242.479411:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970242.479416:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479426:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479447:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e5ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e5e5 expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479458:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479466:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479478:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479486:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479493:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479500:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479505:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970242.479509:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479517:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479536:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.479553:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970242.479577:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.479586:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.479592:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a000/0xc3abfebe76c6e6f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970242.479605:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788970242.479635:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3652:x1875871102176512:12345-0@lo:103: Request processed in 250us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970242.479643:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970242.479685:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102176512:0@lo:103: 00000100:00100000:0.0:1788970242.480616:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102175616:0@lo:103: 00000100:00100000:3.0:1788970242.491532:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:9517:x1875871102174720:12345-0@lo:253: Request processed in 30352us (30698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970242.491547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788970242.491855:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102174720:0@lo:253: 10000000:01000000:0.0:1788970242.491870:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788970242.491873:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970242.491875:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788970242.491876:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970242.491877:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788970242.491878:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970242.491879:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970242.491881:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788970242.491882:0:9517:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788970242.491884:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970242.491885:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970242.491906:0:9517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7d81ace000 from lustre-OST0001 10000000:01000000:0.0:1788970242.491937:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788970242.491940:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788970242.491949:0:9517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7e848519c0 local copy 10000000:01000000:0.0:1788970242.491955:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788970242.491994:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.492005:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.492015:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.492034:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102176640:0@lo:101: 00000100:00100000:0.0:1788970242.492071:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.492113:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.492175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176640 00000100:00100000:2.0:1788970242.492182:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176640 00000100:00100000:2.0:1788970242.492259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788970242.492267:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+14:9517:x1875871102176640:12345-0@lo:101: 00010000:00010000:2.0:1788970242.492279:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970242.492291:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e6fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.492321:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6fd expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.492332:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6fd expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.492359:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99c00, rc 0) 00000100:00100000:2.0:1788970242.492426:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:9517:x1875871102176640:12345-0@lo:101: Request processed in 160us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.492432:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788970242.492504:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102176640:0@lo:101: 00010000:00010000:3.0:1788970242.492517:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.492526:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.492618:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102176768:0@lo:501: 00000100:00100000:3.0:1788970242.492643:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.495966:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e83e51600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970242.497108:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176768 00000100:00100000:0.0:1788970242.497207:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176768 00000100:00100000:0.0:1788970242.497559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788970242.497571:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:9517:x1875871102176768:12345-0@lo:501: 00000100:00100000:0.0:1788970242.497806:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:9517:x1875871102176768:12345-0@lo:501: Request processed in 237us (5160us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788970242.497814:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788970242.498280:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102176768:0@lo:501: 10000000:01000000:3.0:1788970242.498301:0:9517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788970242.498662:0:9517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788970242.498671:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.498682:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.498709:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.498813:0:9517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788970242.498844:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7d81ace000 10000000:01000000:3.0:1788970242.498849:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788970242.498856:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788970242.498858:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970242.498863:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788970242.498867:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788970242.498897:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.498905:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.498916:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.498935:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102176896:0@lo:101: 00000100:00100000:3.0:1788970242.498982:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.499033:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970242.499095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102176896 00000100:00100000:1.0:1788970242.499103:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102176896 00000100:00100000:1.0:1788970242.499156:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788970242.499165:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:9517:x1875871102176896:12345-0@lo:101: 00010000:00010000:1.0:1788970242.499176:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970242.499187:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e70b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.499209:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.499220:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.499228:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4c00, rc 0) 00000100:00100000:1.0:1788970242.499269:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102176896:12345-0@lo:101: Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.499285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788970242.499492:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102176896:0@lo:101: 00010000:00010000:3.0:1788970242.499506:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.499516:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970242.499611:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177024:0@lo:501: 00000100:00100000:3.0:1788970242.499641:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.499669:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.499735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177024 00000100:00100000:2.0:1788970242.499740:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177024 00000100:00100000:2.0:1788970242.499784:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788970242.499792:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177024:12345-0@lo:501: 00000100:00100000:2.0:1788970242.499894:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177024:12345-0@lo:501: Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.499901:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788970242.499979:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177024:0@lo:501: 00000100:00100000:3.0:1788970242.500004:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177152:0@lo:503: 00000100:00100000:3.0:1788970242.500040:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.500061:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970242.500356:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177152 00000100:00100000:1.0:1788970242.500361:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177152 00000100:00100000:1.0:1788970242.500413:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788970242.500422:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177152:12345-0@lo:503: 00000100:00100000:1.0:1788970242.500506:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177152:12345-0@lo:503: Request processed in 85us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.500514:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788970242.500662:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177152:0@lo:503: 00000040:00080000:3.0:1788970242.500913:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970242.500989:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177280:0@lo:502: 00000100:00100000:3.0:1788970242.501031:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.501064:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.501362:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177280 00000100:00100000:2.0:1788970242.501368:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177280 00000100:00100000:2.0:1788970242.501430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788970242.501440:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177280:12345-0@lo:502: 00000100:00100000:2.0:1788970242.501534:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177280:12345-0@lo:502: Request processed in 96us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.501542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970242.501717:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177280:0@lo:502: 00000040:00080000:3.0:1788970242.501935:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788970242.501963:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788970242.501978:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788970242.501992:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788970242.502005:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788970242.502019:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788970242.502042:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177408:0@lo:502: 00000100:00100000:3.0:1788970242.502079:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.502103:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970242.502284:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177408 00000100:00100000:1.0:1788970242.502290:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177408 00000100:00100000:1.0:1788970242.502332:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970242.502347:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177408:12345-0@lo:502: 00000100:00100000:1.0:1788970242.502452:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177408:12345-0@lo:502: Request processed in 113us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.502459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788970242.502833:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177408:0@lo:502: 00000040:00080000:3.0:1788970242.502884:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788970242.502902:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788970242.503553:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788970242.503562:0:9528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788970242.503568:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970242.503570:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788970242.503576:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970242.503593:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a7eaef68000) 00000020:00000080:3.0:1788970242.503616:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788970242.503623:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970242.503705:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81ace000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788970242.503714:0:9528:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970242.503722:0:9528:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3abfebe76c6e720 00010000:00010000:0.0:1788970242.505432:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.505444:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.505456:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e80030000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.505461:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.505471:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.505479:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.505486:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970242.505522:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.505529:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788970242.505615:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102177536:0@lo:103: 00000100:00100000:2.0:1788970242.505686:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970242.505832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177536 00000100:00100000:1.0:1788970242.505839:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177536 00000100:00100000:1.0:1788970242.505891:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970242.505901:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3652:x1875871102177536:12345-0@lo:103: 00010000:00010000:1.0:1788970242.505914:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970242.505928:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e6fd expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.505944:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970242.506002:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.506011:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e80030000/0xc3abfebe76c6e6fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3abfebe76c6e704 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.506037:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.506039:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.506041:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970242.516856:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3652:x1875871102177536:12345-0@lo:103: Request processed in 10946us (11159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.516873:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970242.517010:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102177536:0@lo:103: 00010000:00010000:3.0:1788970242.518257:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788970242.518766:0:9528:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788970242.522998:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788970242.523620:0:9528:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788970242.530053:0:9528:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788970242.530277:0:9528:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788970242.537036:0:9528:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788970242.546637:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788970242.546652:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970242.546658:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970242.546850:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788970242.546855:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970242.546861:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970242.546862:0:9528:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788970242.546866:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788970242.546868:0:9528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788970242.546894:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970242.546897:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970242.546898:0:9528:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788970242.546902:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788970242.553102:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788970242.553160:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788970242.553184:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.553217:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970242.553226:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81ace000 from 1 10000000:01000000:2.0:1788970242.553229:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970242.553558:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.553568:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.553581:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.553603:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef29e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177664:0@lo:101: 00000100:00100000:2.0:1788970242.553674:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.553717:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970242.553827:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177664 00000100:00100000:0.0:1788970242.553835:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177664 00000100:00100000:0.0:1788970242.553884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788970242.553893:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:9517:x1875871102177664:12345-0@lo:101: 00010000:00010000:0.0:1788970242.553907:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970242.553919:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e727 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.553941:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.553952:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.553960:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7e80030000, rc 0) 00000100:00100000:0.0:1788970242.554002:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177664:12345-0@lo:101: Request processed in 110us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.554008:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788970242.554053:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef29e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177664:0@lo:101: 00010000:00010000:0.0:1788970242.554066:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.554074:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.554195:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177792:0@lo:501: 00000100:00100000:0.0:1788970242.554221:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.554256:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.554596:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177792 00000100:00100000:2.0:1788970242.554602:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177792 00000100:00100000:2.0:1788970242.554626:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788970242.554633:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177792:12345-0@lo:501: 00000100:00100000:2.0:1788970242.554756:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177792:12345-0@lo:501: Request processed in 123us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.554762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788970242.554890:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177792:0@lo:501: 00000100:00100000:1.0:1788970242.554919:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177920:0@lo:503: 00000100:00100000:1.0:1788970242.554967:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970242.554993:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970242.555044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102177920 00000100:00100000:0.0:1788970242.555049:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102177920 00000100:00100000:0.0:1788970242.555068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788970242.555074:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177920:12345-0@lo:503: 00000100:00100000:0.0:1788970242.555364:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102177920:12345-0@lo:503: Request processed in 289us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.555371:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788970242.555480:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102177920:0@lo:503: 00000040:00080000:1.0:1788970242.555734:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970242.555795:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178048:0@lo:502: 00000100:00100000:1.0:1788970242.555830:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970242.555854:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970242.556061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178048 00000100:00100000:0.0:1788970242.556066:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178048 00000100:00100000:0.0:1788970242.556099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788970242.556107:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102178048:12345-0@lo:502: 00000100:00100000:0.0:1788970242.556653:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102178048:12345-0@lo:502: Request processed in 545us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.556755:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178048:0@lo:502: 00000040:00080000:1.0:1788970242.556964:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788970242.556992:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788970242.557018:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178176:0@lo:502: 00000100:00100000:1.0:1788970242.557056:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970242.557068:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e23180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970242.557230:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788970242.557331:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178176 00000100:00100000:0.0:1788970242.557345:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178176 00000100:00100000:0.0:1788970242.557368:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788970242.557374:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102178176:12345-0@lo:502: 00000100:00100000:0.0:1788970242.557488:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102178176:12345-0@lo:502: Request processed in 113us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.557494:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788970242.558435:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178176:0@lo:502: 00000040:00080000:1.0:1788970242.558506:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788970242.558517:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788970242.567069:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970242.567566:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970242.567570:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788970242.567579:0:9532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d81ace000 00000020:00000080:2.0:1788970242.567589:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970242.567607:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970242.567610:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970242.567612:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788970242.567615:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788970242.567847:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788970242.567884:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970242.567937:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.567949:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970242.567998:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788970242.568007:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7d81ace000 10000000:01000000:1.0:1788970242.568010:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7d81ace000 10000000:01000000:1.0:1788970242.568014:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970242.568020:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7d81ace000 from 1 10000000:01000000:1.0:1788970242.568023:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788970242.568058:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.568066:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.568090:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970242.568114:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178304:0@lo:101: 00000100:00100000:1.0:1788970242.568192:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970242.568232:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970242.568520:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178304 00000100:00100000:0.0:1788970242.568535:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178304 00000100:00100000:0.0:1788970242.568589:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788970242.568601:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9517:x1875871102178304:12345-0@lo:101: 00010000:00010000:0.0:1788970242.568617:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970242.568631:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e735 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.568654:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.568773:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.568782:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7e80031a00, rc 0) 00000100:00100000:0.0:1788970242.568832:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178304:12345-0@lo:101: Request processed in 233us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.568839:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788970242.568975:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178304:0@lo:101: 00010000:00010000:1.0:1788970242.568990:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970242.568999:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970242.569094:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178432:0@lo:501: 00000100:00100000:1.0:1788970242.569122:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.569325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178432 00000100:00100000:2.0:1788970242.569331:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178432 00000100:00100000:2.0:1788970242.569376:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788970242.569408:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178432:12345-0@lo:501: 00000100:00100000:2.0:1788970242.569516:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178432:12345-0@lo:501: Request processed in 110us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.569522:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788970242.569647:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970242.569659:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178432:0@lo:501: 00000100:00100000:1.0:1788970242.569765:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178560:0@lo:503: 00000100:00100000:1.0:1788970242.569815:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970242.569991:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.570204:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178560 00000100:00100000:2.0:1788970242.570209:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178560 00000100:00100000:2.0:1788970242.570335:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788970242.570351:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178560:12345-0@lo:503: 00000100:00100000:1.0:1788970242.571566:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178560:12345-0@lo:503: Request processed in 1210us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.571577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788970242.571782:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178560:0@lo:503: 00000040:00080000:2.0:1788970242.572040:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970242.572346:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178688:0@lo:502: 00000100:00100000:2.0:1788970242.572435:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.572463:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970242.572524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178688 00000100:00100000:1.0:1788970242.572530:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178688 00000100:00100000:1.0:1788970242.572568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788970242.572577:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178688:12345-0@lo:502: 00000100:00100000:1.0:1788970242.572743:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178688:12345-0@lo:502: Request processed in 166us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970242.572749:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788970242.572871:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178688:0@lo:502: 00000040:00080000:2.0:1788970242.573215:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788970242.573421:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788970242.573442:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788970242.573457:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788970242.573470:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788970242.573482:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788970242.573507:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788970242.573521:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788970242.573536:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788970242.573550:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788970242.573564:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788970242.573577:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788970242.573592:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788970242.573608:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788970242.573622:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788970242.573636:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788970242.573972:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788970242.573999:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788970242.574016:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788970242.574031:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788970242.574043:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788970242.574055:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788970242.574066:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788970242.574610:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788970242.574636:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788970242.574652:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788970242.574675:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788970242.574688:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788970242.574700:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788970242.574714:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788970242.574749:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788970242.574764:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788970242.574776:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788970242.574789:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788970242.574802:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788970242.574817:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788970242.574831:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788970242.574845:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788970242.574875:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788970242.574892:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788970242.574906:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788970242.574919:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788970242.574932:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788970242.574945:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788970242.574957:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788970242.574971:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788970242.575013:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178816:0@lo:502: 00000100:00100000:0.0:1788970242.575091:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.575287:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.575780:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178816 00000100:00100000:2.0:1788970242.575788:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178816 00000100:00100000:2.0:1788970242.575874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788970242.575883:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178816:12345-0@lo:502: 00000100:00100000:2.0:1788970242.576015:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102178816:12345-0@lo:502: Request processed in 132us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.576022:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788970242.576105:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102178816:0@lo:502: 00000040:00080000:1.0:1788970242.576176:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788970242.576187:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788970242.577103:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788970242.577120:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a7eb3dc0000) 00000020:00000080:1.0:1788970242.577151:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788970242.577247:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81ace000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788970242.577251:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81ace000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788970242.577254:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81ace000 3 00010000:00080000:1.0:1788970242.577285:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d82791800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1788970242.578950:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788970242.579161:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788970242.579198:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788970242.579209:0:9533:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3abfebe76c6e74a 00000100:00080000:1.0:1788970242.579218:0:9533:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970242.579227:0:9533:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7d82791800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970242.579265:0:9533:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf3770c0 x1875871102178944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970242.579295:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788970242.581592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102178944:0@lo:38: 00000100:00100000:0.0:1788970242.581687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.581840:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102178944 00000100:00100000:0.0:1788970242.581849:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102178944 00000100:00100000:0.0:1788970242.581882:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970242.581890:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102178944:12345-0@lo:38: 00010000:00080000:0.0:1788970242.581916:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:0.0:1788970242.581964:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3abfebe76c6e751 00000004:00100000:0.0:1788970242.581979:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970242.582012:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8a7d81a3c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970242.582075:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875871102178944:12345-0@lo:38: Request processed in 184us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.582349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970242.582376:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102179072:0@lo:400: 00000100:00100000:0.0:1788970242.582428:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.582449:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102179584:0@lo:400: 00000100:00100000:0.0:1788970242.582467:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.582483:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788970242.582489:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d825492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102179200:0@lo:400: 00000100:00100000:0.0:1788970242.582506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.582515:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102179712:0@lo:400: 00000100:00100000:0.0:1788970242.582534:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.582561:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102179328:0@lo:400: 00000100:00100000:0.0:1788970242.582596:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.582615:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102179840:0@lo:400: 00000100:00100000:0.0:1788970242.582635:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.582652:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970242.583214:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102179456:0@lo:400: 00000100:00100000:0.0:1788970242.583307:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.583351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179072 00000100:00100000:0.0:1788970242.583357:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179072 00000100:00100000:0.0:1788970242.583408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179584 00000100:00100000:0.0:1788970242.583412:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179584 00000100:00100000:0.0:1788970242.583424:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179200 00000100:00100000:0.0:1788970242.583426:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179200 00000100:00100000:0.0:1788970242.583433:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179456 00000100:00100000:0.0:1788970242.583435:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179456 00000100:00100000:0.0:1788970242.583447:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788970242.583462:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102179072:12345-0@lo:400: 00000100:00100000:0.0:1788970242.583504:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102179072:12345-0@lo:400: Request processed in 42us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.583510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788970242.583524:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970242.583529:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d825483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102179584:12345-0@lo:400: 00000100:00100000:0.0:1788970242.583556:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d825483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102179584:12345-0@lo:400: Request processed in 26us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.583562:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970242.583575:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970242.583580:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102179200:12345-0@lo:400: 00000100:00100000:0.0:1788970242.583605:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102179200:12345-0@lo:400: Request processed in 26us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.583611:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970242.583620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970242.583626:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d833883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102179456:12345-0@lo:400: 00000100:00100000:0.0:1788970242.583653:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d833883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102179456:12345-0@lo:400: Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.583658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788970242.585827:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf3770c0 x1875871102178944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.585842:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970242.585852:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788970242.585861:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788970242.585866:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788970242.585869:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788970242.585884:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102178944:0@lo:38: 00000100:00100000:0.0:1788970242.585928:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179712 00000100:00100000:0.0:1788970242.585936:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179712 00000100:00100000:0.0:1788970242.585970:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179840 00000100:00100000:0.0:1788970242.585973:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179840 00000100:00100000:0.0:1788970242.585995:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970242.586002:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82549680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102179712:12345-0@lo:400: 00000100:00100000:0.0:1788970242.586075:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82549680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102179712:12345-0@lo:400: Request processed in 73us (3539us total) trans 0 rc 0/0 00000020:01000004:3.0:1788970242.586546:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788970242.586578:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a7d83390000) 00000020:00000080:3.0:1788970242.586604:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:2.0:1788970242.586799:0:9534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875871102179968:0@lo:901: 00000100:00100000:2.0:1788970242.586843:0:9534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.586870:0:9534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37e40 going to sleep for 11 seconds 00000020:01000004:3.0:1788970242.587646:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81ace000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970242.587652:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81ace000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970242.587655:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81ace000 3 00010000:00080000:3.0:1788970242.587693:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d831e0800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.115@tcp at head 00000100:00100000:0.0:1788970242.588246:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970242.588276:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970242.588287:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102179840:12345-0@lo:400: 00000100:00100000:0.0:1788970242.588358:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102179840:12345-0@lo:400: Request processed in 76us (5722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.588365:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970242.588402:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179328 00000100:00100000:0.0:1788970242.588409:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179328 00000100:00100000:0.0:1788970242.588444:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788970242.588451:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102179328:12345-0@lo:400: 00000100:00100000:0.0:1788970242.588496:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102179328:12345-0@lo:400: Request processed in 46us (5900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.588503:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788970242.588543:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d825492c0 x1875871102179200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588557:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d825492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102179200:0@lo:400: 00010000:00080000:0.0:1788970242.588569:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d82548f00 x1875871102179712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588585:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102179712:0@lo:400: 00010000:00080000:0.0:1788970242.588599:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d82549a40 x1875871102179072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588606:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102179072:0@lo:400: 00010000:00080000:0.0:1788970242.588616:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8254b480 x1875871102179584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588624:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102179584:0@lo:400: 00010000:00080000:0.0:1788970242.588663:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8254bc00 x1875871102179456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588671:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102179456:0@lo:400: 00000100:00100000:0.0:1788970242.588683:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102179328:0@lo:400: 00010000:00080000:0.0:1788970242.588692:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d82549e00 x1875871102179840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588701:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102179840:0@lo:400: 00000100:00100000:0.0:1788970242.588740:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102179968 00000100:00100000:0.0:1788970242.588745:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102179968 00000100:00100000:0.0:1788970242.588777:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970242.588784:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875871102179968:12345-0@lo:901: 00000100:00100000:0.0:1788970242.588860:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875871102179968:12345-0@lo:901: Request processed in 76us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.588866:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788970242.588884:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788970242.588913:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7eaef2a940 x1875871102179968/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788970258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970242.588922:0:9534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875871102179968:0@lo:901: 00010000:00010000:3.0:1788970242.594704:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788970242.594870:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788970242.594911:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970242.594922:0:9533:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc3abfebe76c6e75f 00000100:00080000:3.0:1788970242.594933:0:9533:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970242.594942:0:9533:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a7d831e0800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970242.594976:0:9533:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8276f480 x1875871102180096/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970242.594998:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788970242.595043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102180096:0@lo:38: 00000100:00100000:3.0:1788970242.595103:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.597441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180096 00000100:00100000:3.0:1788970242.597459:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180096 00000100:00100000:3.0:1788970242.597506:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970242.597514:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102180096:12345-0@lo:38: 00010000:00080000:3.0:1788970242.597548:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1788970242.597583:0:6525:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc3abfebe76c6e766 00000004:00100000:3.0:1788970242.597597:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788970242.597628:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8a7d831e2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970242.597720:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875871102180096:12345-0@lo:38: Request processed in 205us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970242.597727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788970242.597781:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8276f480 x1875871102180096/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970242.597792:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970242.597799:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788970242.597805:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788970242.597810:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788970242.597812:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d831e0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970242.597818:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102180096:0@lo:38: 00000040:00080000:3.0:1788970242.599899:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788970242.600010:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788970242.600039:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970242.600055:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970242.600069:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788970242.600124:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788970242.600126:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970242.601229:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970242.601231:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970242.601288:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970242.601291:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970242.601292:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970242.601294:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970242.601295:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970242.601297:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970242.601298:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970242.601301:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788970242.601304:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970242.601305:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970242.601307:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970242.601314:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970242.601315:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970242.601316:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970242.601317:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970242.601318:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788970242.601318:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788970242.601319:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970242.601320:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970242.601355:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788970242.601374:0:9517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102180224:0@lo:253: 00000100:00100000:3.0:1788970242.601464:0:9517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970242.601504:0:9517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e884179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970242.601537:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180224 00000100:00100000:3.0:1788970242.601544:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180224 00000100:00100000:3.0:1788970242.601590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788970242.601599:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102180224:12345-0@lo:253: 20000000:01000000:3.0:1788970242.601628:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788970242.601641:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788970242.610750:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788970242.610769:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788970242.611055:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9517:x1875871102180224:12345-0@lo:253: Request processed in 9453us (9587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.611067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788970242.611174:0:9517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5fe147a8-4210-48cf-8358-c541b06e4cd0:9517:1875871102180224:0@lo:253: 10000000:01000000:1.0:1788970242.611189:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788970242.611193:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970242.611195:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788970242.611196:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970242.611198:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970242.611199:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970242.611200:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970242.611202:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970242.611203:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788970242.611205:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788970242.611206:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970242.611208:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970242.611222:0:9517:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788970242.614643:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788970242.614655:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788970242.614692:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.614711:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.614718:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.614742:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.614787:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.614804:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 16 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.614818:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102180352:0@lo:104: 00000100:00100000:2.0:1788970242.614891:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970242.614958:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.614966:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970242.614974:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102180480:0@lo:104: 00000100:00100000:2.0:1788970242.615011:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970242.615033:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970242.615057:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180352 00000100:00100000:2.0:1788970242.615064:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180352 00000100:00100000:2.0:1788970242.615101:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180480 00000100:00100000:2.0:1788970242.615104:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180480 00000100:00100000:2.0:1788970242.615119:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970242.615140:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6540:x1875871102180352:12345-0@lo:104: 00010000:00010000:2.0:1788970242.615152:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.615224:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970242.615230:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:6540:x1875871102180352:12345-0@lo:104: Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.615237:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970242.615255:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970242.615262:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102180480:12345-0@lo:104: 00010000:00010000:2.0:1788970242.615269:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970242.615300:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788970242.615305:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:6540:x1875871102180480:12345-0@lo:104: Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970242.615311:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970242.615355:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102180352:0@lo:104: 00000100:00100000:2.0:1788970242.615364:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875871102180480:0@lo:104: 00010000:00010000:2.0:1788970242.615404:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615470:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970242.615477:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615484:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.615488:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615497:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.615504:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.615510:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970242.615547:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615554:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970242.615573:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615591:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5800/0xc3abfebe76c6e6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e6a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615606:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970242.615610:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615615:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970242.615619:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615626:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970242.615633:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970242.615638:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970242.615651:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615657:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970242.615670:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615676:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99600/0xc3abfebe76c6e65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e663 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615687:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.615694:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970242.615696:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970242.615709:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102180608:0@lo:103: 00000100:00100000:0.0:1788970242.615738:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.615775:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102180736:0@lo:103: 00000100:00100000:0.0:1788970242.615794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970242.615825:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180608 00000100:00100000:0.0:1788970242.615829:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180608 00010000:00010000:0.0:1788970242.615849:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 17 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.615867:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180736 00000100:00100000:0.0:1788970242.615870:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180736 00010000:00010000:0.0:1788970242.615879:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 18 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.615901:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970242.615908:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:3652:x1875871102180608:12345-0@lo:103: 00010000:00010000:0.0:1788970242.615918:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.615923:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 18 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615933:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 18 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615945:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e6a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e6a2 expref: 18 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.615956:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970242.615981:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:3652:x1875871102180608:12345-0@lo:103: Request processed in 74us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.615994:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970242.616009:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788970242.616015:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83388f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:3649:x1875871102180736:12345-0@lo:103: 00010000:00010000:0.0:1788970242.616022:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970242.616026:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616035:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616044:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99000/0xc3abfebe76c6e663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e65c expref: 16 pid: 6518 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616054:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616063:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788970242.616077:0:7932:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007379733s 00010000:00010000:0.0:1788970242.616082:0:7932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616089:0:7932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616097:0:7932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616103:0:7932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616115:0:7932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970242.616119:0:7932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616128:0:7932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616142:0:7932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616152:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970242.616176:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83388f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3649:x1875871102180736:12345-0@lo:103: Request processed in 162us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970242.616183:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788970242.616207:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616214:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970242.616221:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6e76d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970242.616244:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102180736:0@lo:103: 00000100:00100000:0.0:1788970242.616263:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102180608:0@lo:103: 00010000:00010000:3.0:1788970242.616573:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788970242.619367:0:9517:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788970242.619564:0:9517:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788970242.619766:0:9517:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788970242.619932:0:9517:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788970242.620443:0:9517:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788970242.620720:0:9517:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788970242.622001:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788970242.642364:0:9517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788970242.642374:0:9517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788970242.642450:0:9517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788970242.642496:0:9517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788970242.642515:0:9517:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788970242.642534:0:9517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788970242.643240:0:9517:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970242.643457:0:9517:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788970243.100691:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788970243.571755:0:9589:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970243.571989:0:9589:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788970243.870486:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970243.870515:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102180864:0@lo:41: 00000100:00100000:3.0:1788970243.870584:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970243.870722:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180864 00000100:00100000:1.0:1788970243.870731:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180864 00000100:00100000:1.0:1788970243.870795:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970243.870805:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102180864:12345-0@lo:41: 00000004:00000024:1.0:1788970243.870837:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788970243.870914:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102180864:12345-0@lo:41: Request processed in 111us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970243.870920:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970243.871164:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102180864:0@lo:41: 00010000:00010000:0.0:1788970244.126625:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.149904:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970246.174954:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970246.431509:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83514f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102180992:0@lo:13: 00000100:00100000:0.0:1788970246.431646:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970246.431725:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102180992 00000100:00100000:0.0:1788970246.431733:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102180992 00000100:00100000:0.0:1788970246.431785:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970246.431795:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102180992:12345-0@lo:13: 00002000:00000024:0.0:1788970246.431822:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970246.431867:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102180992:12345-0@lo:13: Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970246.431874:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788970246.431895:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788970246.431925:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83514f00 x1875871102180992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970246.432053:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83514f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102180992:0@lo:13: 00000100:00100000:0.0:1788970246.432684:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102181120:0@lo:13: 00000100:00100000:0.0:1788970246.432724:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970246.432764:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181120 00000100:00100000:0.0:1788970246.432769:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181120 00000100:00100000:0.0:1788970246.432803:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970246.432810:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102181120:12345-0@lo:13: 00002000:00000024:0.0:1788970246.432825:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970246.432858:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102181120:12345-0@lo:13: Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970246.432864:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788970246.432881:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788970246.432906:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83388b40 x1875871102181120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970246.432921:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102181120:0@lo:13: 00010000:00010000:0.0:1788970247.202574:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970247.456264:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970247.456289:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102181248:0@lo:41: 00000100:00100000:1.0:1788970247.456356:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970247.456457:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181248 00000100:00100000:1.0:1788970247.456464:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181248 00000100:00100000:1.0:1788970247.456508:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970247.456516:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102181248:12345-0@lo:41: 00000004:00000024:1.0:1788970247.456551:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788970247.456592:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102181248:12345-0@lo:41: Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970247.456598:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970247.456636:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102181248:0@lo:41: 00000100:00100000:0.0:1788970247.965109:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102181376:0@lo:400: 00000100:00100000:0.0:1788970247.965183:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965229:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102181888:0@lo:400: 00000100:00100000:0.0:1788970247.965253:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965272:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102182400:0@lo:400: 00000100:00100000:0.0:1788970247.965291:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965325:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788970247.965332:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102181760:0@lo:400: 00000100:00100000:0.0:1788970247.965352:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965367:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102182272:0@lo:400: 00000100:00100000:0.0:1788970247.965412:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965438:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102181504:0@lo:400: 00000100:00100000:0.0:1788970247.965456:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965469:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102182016:0@lo:400: 00000100:00100000:0.0:1788970247.965497:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965512:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102182528:0@lo:400: 00000100:00100000:0.0:1788970247.965530:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965541:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788970247.965546:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d833892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102181632:0@lo:400: 00000100:00100000:0.0:1788970247.965560:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965575:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102182144:0@lo:400: 00000100:00100000:0.0:1788970247.965588:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965595:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102182656:0@lo:400: 00000100:00100000:0.0:1788970247.965624:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970247.965647:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181888 00000100:00100000:0.0:1788970247.965654:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181888 00000100:00100000:0.0:1788970247.965693:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181632 00000100:00100000:0.0:1788970247.965696:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181632 00000100:00100000:0.0:1788970247.965709:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788970247.965717:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102181888:12345-0@lo:400: 00000100:00100000:0.0:1788970247.965766:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102181888:12345-0@lo:400: Request processed in 50us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970247.965773:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788970247.965790:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970247.965795:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102181632:12345-0@lo:400: 00000100:00100000:0.0:1788970247.965825:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102181632:12345-0@lo:400: Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966057:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181760 00000100:00100000:3.0:1788970247.966068:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181760 00000100:00100000:3.0:1788970247.966091:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181504 00000100:00100000:3.0:1788970247.966093:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181504 00000100:00100000:3.0:1788970247.966104:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182016 00000100:00100000:3.0:1788970247.966106:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182016 00000100:00100000:3.0:1788970247.966128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182528 00000100:00100000:3.0:1788970247.966131:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182528 00000100:00100000:3.0:1788970247.966142:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182144 00000100:00100000:3.0:1788970247.966144:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182144 00000100:00100000:3.0:1788970247.966156:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182656 00000100:00100000:3.0:1788970247.966158:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182656 00000100:00100000:3.0:1788970247.966170:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970247.966176:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82549a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102181760:12345-0@lo:400: 00000100:00100000:3.0:1788970247.966213:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82549a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102181760:12345-0@lo:400: Request processed in 36us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966219:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970247.966233:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970247.966239:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d825492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102181504:12345-0@lo:400: 00000100:00100000:3.0:1788970247.966267:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d825492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102181504:12345-0@lo:400: Request processed in 28us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966273:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970247.966284:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970247.966290:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102182016:12345-0@lo:400: 00000100:00100000:3.0:1788970247.966327:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102182016:12345-0@lo:400: Request processed in 38us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966333:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970247.966344:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970247.966350:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102182528:12345-0@lo:400: 00000100:00100000:3.0:1788970247.966376:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102182528:12345-0@lo:400: Request processed in 26us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970247.966419:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970247.966425:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102182144:12345-0@lo:400: 00000100:00100000:3.0:1788970247.966453:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102182144:12345-0@lo:400: Request processed in 29us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970247.966470:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970247.966476:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102182656:12345-0@lo:400: 00000100:00100000:3.0:1788970247.966501:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102182656:12345-0@lo:400: Request processed in 25us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970247.966506:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788970247.966524:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970247.966528:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970247.967019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102181376 00000100:00100000:2.0:1788970247.967025:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102181376 00000100:00100000:2.0:1788970247.967180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788970247.967188:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3650:x1875871102181376:12345-0@lo:400: 00000100:00100000:2.0:1788970247.967232:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:3650:x1875871102181376:12345-0@lo:400: Request processed in 45us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970247.967238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788970247.968459:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970247.968491:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182400 00000100:00100000:0.0:1788970247.968497:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182400 00000100:00100000:0.0:1788970247.968527:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182272 00000100:00100000:0.0:1788970247.968531:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182272 00000100:00100000:0.0:1788970247.968550:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970247.968557:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102182400:12345-0@lo:400: 00000100:00100000:0.0:1788970247.968611:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102182400:12345-0@lo:400: Request processed in 54us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970247.968617:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970247.968628:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970247.968634:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102182272:12345-0@lo:400: 00000100:00100000:0.0:1788970247.968661:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102182272:12345-0@lo:400: Request processed in 28us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970247.968674:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970247.968742:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d833892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102181632:0@lo:400: 00010000:00080000:0.0:1788970247.968759:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83389680 x1875871102182144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970247.968770:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102182144:0@lo:400: 00010000:00080000:0.0:1788970247.968781:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8254a580 x1875871102182656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970247.968789:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102182656:0@lo:400: 00010000:00080000:0.0:1788970247.968799:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83389a40 x1875871102181504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970247.968808:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102181504:0@lo:400: 00010000:00080000:0.0:1788970247.968818:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83388780 x1875871102182016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970247.968826:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102182016:0@lo:400: 00010000:00080000:1.0:1788970247.969243:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338a580 x1875871102181760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970247.969254:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102181760:0@lo:400: 00010000:00080000:1.0:1788970247.969266:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338b480 x1875871102182272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970247.969274:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102182272:0@lo:400: 00000100:00100000:1.0:1788970247.969283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102181376:0@lo:400: 00000100:00100000:1.0:1788970247.969293:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102181888:0@lo:400: 00010000:00080000:1.0:1788970247.970012:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83389e00 x1875871102182400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970247.970043:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102182400:0@lo:400: 00010000:00080000:0.0:1788970247.970428:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d82549e00 x1875871102182528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970247.970439:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102182528:0@lo:400: 00010000:00010000:0.0:1788970248.220629:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788970248.553990:0:9879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788970248.988749:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970248.993823:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102182784:0@lo:41: 00000100:00100000:1.0:1788970248.993990:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970248.994173:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182784 00000100:00100000:0.0:1788970248.994182:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182784 00000100:00100000:0.0:1788970248.994235:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788970248.994246:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102182784:12345-0@lo:41: 00000004:00000024:0.0:1788970248.994319:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788970248.994413:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102182784:12345-0@lo:41: Request processed in 168us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970248.994420:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788970248.994610:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102182784:0@lo:41: 00010000:00010000:0.0:1788970249.250727:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788970249.517040:0:9931:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970249.517231:0:9931:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788970250.015182:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788970250.015189:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eaed7c000 from 39 10000000:01000000:1.0:1788970250.015193:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788970250.015244:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.015255:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.015266:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.015298:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102182912:0@lo:101: 00000100:00100000:1.0:1788970250.015359:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.015424:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.015597:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102182912 00000100:00100000:2.0:1788970250.015615:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102182912 00000100:00100000:2.0:1788970250.015671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788970250.015680:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102182912:12345-0@lo:101: 00010000:00010000:2.0:1788970250.015692:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970250.015704:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e774 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.015727:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.015737:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.015746:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99c00, rc 0) 00000100:00100000:2.0:1788970250.015791:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102182912:12345-0@lo:101: Request processed in 112us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.015797:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788970250.015841:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102182912:0@lo:101: 00010000:00010000:2.0:1788970250.015855:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.015864:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970250.015920:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83514b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183040:0@lo:501: 00000100:00100000:2.0:1788970250.015942:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.015962:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.015975:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183040 00000100:00100000:2.0:1788970250.015979:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183040 00000100:00100000:2.0:1788970250.016007:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788970250.016013:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102183040:12345-0@lo:501: 00000100:00100000:2.0:1788970250.016122:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102183040:12345-0@lo:501: Request processed in 109us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.016129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788970250.016155:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83514b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183040:0@lo:501: 00000100:00100000:2.0:1788970250.016953:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83514b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183168:0@lo:503: 00000100:00100000:2.0:1788970250.017124:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.017203:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.021418:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183168 00000100:00100000:3.0:1788970250.021431:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183168 00000100:00100000:3.0:1788970250.021481:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788970250.021490:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102183168:12345-0@lo:503: 00000100:00100000:3.0:1788970250.021645:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102183168:12345-0@lo:503: Request processed in 156us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.021653:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788970250.022516:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83514b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183168:0@lo:503: 00000100:00100000:3.0:1788970250.022832:0:9957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9957:1875871102183296:0@lo:502: 00000100:00100000:3.0:1788970250.022887:0:9957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.022925:0:9957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.022974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183296 00000100:00100000:1.0:1788970250.022979:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183296 00000100:00100000:1.0:1788970250.023019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788970250.023027:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9957:x1875871102183296:12345-0@lo:502: 00000100:00100000:1.0:1788970250.023126:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9957:x1875871102183296:12345-0@lo:502: Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.023133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788970250.023295:0:9957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9957:1875871102183296:0@lo:502: 00000100:00100000:3.0:1788970250.023337:0:9957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9957:1875871102183424:0@lo:502: 00000100:00100000:3.0:1788970250.023370:0:9957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.023407:0:9957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.024130:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183424 00000100:00100000:2.0:1788970250.024137:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183424 00000100:00100000:2.0:1788970250.024210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788970250.024218:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9957:x1875871102183424:12345-0@lo:502: 00000100:00100000:2.0:1788970250.024320:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:9957:x1875871102183424:12345-0@lo:502: Request processed in 103us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.024326:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788970250.024618:0:9957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9957:1875871102183424:0@lo:502: 00000040:00080000:3.0:1788970250.024645:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788970250.024747:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788970250.024769:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788970250.024778:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.024790:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970250.024799:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788970250.024801:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788970250.024804:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788970250.024827:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.024835:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.024844:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970250.024858:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183552:0@lo:101: 00000100:00100000:0.0:1788970250.024886:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.024919:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d821639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.024958:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183552 00000100:00100000:2.0:1788970250.024962:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183552 00000100:00100000:2.0:1788970250.024992:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788970250.024998:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102183552:12345-0@lo:101: 00010000:00010000:2.0:1788970250.025006:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970250.025017:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e782 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.025038:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.025060:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.025067:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99600, rc 0) 00000100:00100000:2.0:1788970250.025096:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102183552:12345-0@lo:101: Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.025102:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788970250.025157:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183552:0@lo:101: 00010000:00010000:0.0:1788970250.025176:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.025194:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970250.025246:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183680:0@lo:501: 00000100:00100000:0.0:1788970250.025269:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.025298:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d821639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.025311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183680 00000100:00100000:0.0:1788970250.025315:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183680 00000100:00100000:0.0:1788970250.025337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970250.025342:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102183680:12345-0@lo:501: 00000100:00100000:0.0:1788970250.025474:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102183680:12345-0@lo:501: Request processed in 131us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.025481:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970250.025519:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183680:0@lo:501: 00000100:00100000:0.0:1788970250.025539:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183808:0@lo:503: 00000100:00100000:0.0:1788970250.025569:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.025580:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d821639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.025589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183808 00000100:00100000:0.0:1788970250.025592:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183808 00000100:00100000:0.0:1788970250.025608:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788970250.025613:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102183808:12345-0@lo:503: 00000100:00100000:0.0:1788970250.025670:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102183808:12345-0@lo:503: Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.025676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788970250.025712:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102183808:0@lo:503: 00000100:00100000:3.0:1788970250.027663:0:9958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9958:1875871102183936:0@lo:502: 00000100:00100000:3.0:1788970250.027730:0:9958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.027768:0:9958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.027810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102183936 00000100:00100000:0.0:1788970250.027816:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102183936 00000100:00100000:0.0:1788970250.027862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788970250.027870:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9958:x1875871102183936:12345-0@lo:502: 00000100:00100000:0.0:1788970250.027987:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9958:x1875871102183936:12345-0@lo:502: Request processed in 117us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.027995:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788970250.028089:0:9958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9958:1875871102183936:0@lo:502: 00000020:01000000:3.0:1788970250.028114:0:9958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970250.028123:0:9958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970250.028126:0:9958:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788970250.028131:0:9958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788970250.028133:0:9958:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788970250.028149:0:9958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9958:1875871102184064:0@lo:502: 00000100:00100000:3.0:1788970250.028191:0:9958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.028274:0:9958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.028370:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184064 00000100:00100000:0.0:1788970250.028375:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184064 00000100:00100000:0.0:1788970250.028622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788970250.028629:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9958:x1875871102184064:12345-0@lo:502: 00000100:00100000:0.0:1788970250.028707:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:9958:x1875871102184064:12345-0@lo:502: Request processed in 78us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.028714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788970250.029357:0:9958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9958:1875871102184064:0@lo:502: 00000020:01000000:3.0:1788970250.029411:0:9958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970250.029418:0:9958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970250.029420:0:9958:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788970250.029423:0:9958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788970250.029566:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788970250.029585:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788970250.029595:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.029607:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970250.029617:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788970250.029619:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7ebb899800 from 39 10000000:01000000:1.0:1788970250.029622:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788970250.029652:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.029660:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.029670:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.029684:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184192:0@lo:101: 00000100:00100000:1.0:1788970250.029721:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.029752:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.029794:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184192 00000100:00100000:3.0:1788970250.029799:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184192 00000100:00100000:3.0:1788970250.029837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788970250.029845:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102184192:12345-0@lo:101: 00010000:00010000:3.0:1788970250.029861:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970250.029873:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e790 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.029895:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.029905:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.029913:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9bc00, rc 0) 00000100:00100000:3.0:1788970250.029947:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102184192:12345-0@lo:101: Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.029953:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788970250.029981:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184192:0@lo:101: 00010000:00010000:3.0:1788970250.029992:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.030000:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970250.030040:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184320:0@lo:501: 00000100:00100000:3.0:1788970250.030060:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.030069:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.030353:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184320 00000100:00100000:1.0:1788970250.030358:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184320 00000100:00100000:1.0:1788970250.030405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788970250.030412:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102184320:12345-0@lo:501: 00000100:00100000:1.0:1788970250.030509:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102184320:12345-0@lo:501: Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.030515:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788970250.031334:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184320:0@lo:501: 00000100:00100000:3.0:1788970250.031372:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184448:0@lo:503: 00000100:00100000:3.0:1788970250.031437:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.031470:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.031602:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184448 00000100:00100000:1.0:1788970250.031607:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184448 00000100:00100000:1.0:1788970250.031641:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788970250.031648:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102184448:12345-0@lo:503: 00000100:00100000:1.0:1788970250.031729:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102184448:12345-0@lo:503: Request processed in 81us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.031736:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788970250.031772:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184448:0@lo:503: 00000100:00100000:1.0:1788970250.031966:0:9960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9960:1875871102184576:0@lo:502: 00000100:00100000:1.0:1788970250.031995:0:9960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.032006:0:9960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.032049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184576 00000100:00100000:3.0:1788970250.032054:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184576 00000100:00100000:3.0:1788970250.032080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788970250.032085:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:9960:x1875871102184576:12345-0@lo:502: 00000100:00100000:3.0:1788970250.032162:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:9960:x1875871102184576:12345-0@lo:502: Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.032168:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788970250.033348:0:9960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9960:1875871102184576:0@lo:502: 00000100:00100000:1.0:1788970250.033430:0:9960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9960:1875871102184704:0@lo:502: 00000100:00100000:1.0:1788970250.033474:0:9960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.033503:0:9960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.033607:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184704 00000100:00100000:2.0:1788970250.033612:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184704 00000100:00100000:2.0:1788970250.033650:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788970250.033658:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:9960:x1875871102184704:12345-0@lo:502: 00000100:00100000:2.0:1788970250.033755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:9960:x1875871102184704:12345-0@lo:502: Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.033762:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788970250.033849:0:9960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9960:1875871102184704:0@lo:502: 00000040:00080000:0.0:1788970250.033870:0:9960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788970250.034037:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788970250.034056:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970250.034064:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.034075:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970250.034083:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788970250.034085:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebb899800 from 6 10000000:01000000:2.0:1788970250.034088:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970250.034110:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.034128:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.034137:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970250.034149:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184832:0@lo:101: 00000100:00100000:2.0:1788970250.034177:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.035356:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.035521:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184832 00000100:00100000:0.0:1788970250.035528:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184832 00000100:00100000:0.0:1788970250.035569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788970250.035578:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102184832:12345-0@lo:101: 00010000:00010000:0.0:1788970250.035590:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970250.035608:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7e80031600/0xc3abfebe76c6e7a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e79e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.035632:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7e80031600/0xc3abfebe76c6e7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e79e expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.035653:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7e80031600/0xc3abfebe76c6e7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e79e expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.035662:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7e80031600, rc 0) 00000100:00100000:0.0:1788970250.035717:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102184832:12345-0@lo:101: Request processed in 141us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.035724:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788970250.035861:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184832:0@lo:101: 00010000:00010000:1.0:1788970250.035877:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.035886:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.035939:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184960:0@lo:256: 00000100:00100000:1.0:1788970250.035974:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.036005:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.036048:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102184960 00000100:00100000:2.0:1788970250.036052:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102184960 00000100:00100000:2.0:1788970250.036084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788970250.036091:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102184960:12345-0@lo:256: 20000000:01000000:2.0:1788970250.036103:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970250.036119:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970250.036122:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788970250.036329:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102184960:12345-0@lo:256: Request processed in 238us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.036336:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788970250.036427:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102184960:0@lo:256: 10000000:01000000:1.0:1788970250.036475:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970250.036481:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.036490:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970250.036497:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788970250.036500:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1788970250.036502:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788970250.036522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.036529:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.036536:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.036547:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185088:0@lo:101: 00000100:00100000:1.0:1788970250.036571:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.036586:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.036640:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185088 00000100:00100000:0.0:1788970250.036644:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185088 00000100:00100000:0.0:1788970250.036671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788970250.036677:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102185088:12345-0@lo:101: 00010000:00010000:0.0:1788970250.036685:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970250.036694:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e7ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.036709:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.036717:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.036723:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7e80031800, rc 0) 00000100:00100000:0.0:1788970250.036748:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102185088:12345-0@lo:101: Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.036754:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788970250.036888:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185088:0@lo:101: 00010000:00010000:1.0:1788970250.036899:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.036907:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.036965:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185216:0@lo:501: 00000100:00100000:1.0:1788970250.036986:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.037012:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.037047:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185216 00000100:00100000:0.0:1788970250.037051:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185216 00000100:00100000:0.0:1788970250.037107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788970250.037119:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102185216:12345-0@lo:501: 00000100:00100000:0.0:1788970250.037242:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102185216:12345-0@lo:501: Request processed in 122us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.037248:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788970250.037304:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185216:0@lo:501: 00000100:00100000:1.0:1788970250.037328:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185344:0@lo:503: 00000100:00100000:1.0:1788970250.037365:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.040940:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.041097:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185344 00000100:00100000:2.0:1788970250.041108:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185344 00000100:00100000:2.0:1788970250.041785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788970250.041911:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102185344:12345-0@lo:503: 00000100:00100000:2.0:1788970250.042054:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102185344:12345-0@lo:503: Request processed in 259us (4688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.042062:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788970250.042109:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185344:0@lo:503: 00000100:00100000:2.0:1788970250.044585:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9963:1875871102185472:0@lo:502: 00000100:00100000:2.0:1788970250.044655:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.044689:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185472 00000100:00100000:2.0:1788970250.044696:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185472 00000100:00100000:2.0:1788970250.044728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788970250.044736:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:9963:x1875871102185472:12345-0@lo:502: 00000100:00100000:2.0:1788970250.044843:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:9963:x1875871102185472:12345-0@lo:502: Request processed in 107us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.044851:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788970250.044887:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ed9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.044907:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9963:1875871102185472:0@lo:502: 00000020:01000000:2.0:1788970250.044933:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970250.044940:0:9963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788970250.044946:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970250.044948:0:9963:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788970250.044954:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788970250.044958:0:9963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1788970250.044979:0:9963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788970250.044981:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970250.044997:0:9963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a7d81ae8000) 00000020:00000080:2.0:1788970250.045021:0:9963:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788970250.045027:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788970250.045108:0:9963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788970250.045115:0:9963:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788970250.045122:0:9963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6e7c1 00010000:00080000:2.0:1788970250.045151:0:9963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf421000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970250.048974:0:9963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788970250.049108:0:9963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788970250.049123:0:9963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788970250.049422:0:9963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970250.049527:0:9963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970250.049648:0:9963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788970250.049743:0:9963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788970250.054601:0:9964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970250.054608:0:9964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788970250.055320:0:9963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788970250.055331:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788970250.055368:0:9963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788970250.055420:0:9963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e7c8 00000100:00080000:2.0:1788970250.055432:0:9963:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970250.055443:0:9963:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebf421000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970250.055478:0:9963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83515a40 x1875871102185600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970250.055502:0:9963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788970250.055545:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970250.055549:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970250.055551:0:9963:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788970250.055553:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970250.055557:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970250.055558:0:9963:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970250.055561:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970250.055562:0:9963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788970250.055586:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9963:1875871102185728:0@lo:502: 00000100:00100000:2.0:1788970250.055657:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.055695:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185728 00000100:00100000:2.0:1788970250.055701:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185728 00000100:00100000:2.0:1788970250.055740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788970250.055748:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:9963:x1875871102185728:12345-0@lo:502: 00000100:00100000:2.0:1788970250.055844:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:9963:x1875871102185728:12345-0@lo:502: Request processed in 97us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.055852:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788970250.055894:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.055915:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9963:1875871102185728:0@lo:502: 00000020:01000000:2.0:1788970250.055935:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970250.055943:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970250.055944:0:9963:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788970250.055948:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1788970250.055989:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788970250.056009:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788970250.056018:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.056029:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970250.056039:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788970250.056042:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eb0d2c000 from 39 10000000:01000000:2.0:1788970250.056044:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970250.056063:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.056071:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970250.056078:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970250.056088:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185856:0@lo:101: 00000100:00100000:2.0:1788970250.056110:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.056130:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.056417:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102185600:0@lo:8: 00000100:00100000:1.0:1788970250.056452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.056574:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102185984:0@lo:400: 00000100:00100000:1.0:1788970250.056600:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.056618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102186496:0@lo:400: 00000100:00100000:1.0:1788970250.056638:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.056652:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102187008:0@lo:400: 00000100:00100000:1.0:1788970250.056671:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.056689:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788970250.056695:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102186368:0@lo:400: 00000100:00100000:1.0:1788970250.056714:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.056730:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102186880:0@lo:400: 00000100:00100000:1.0:1788970250.056749:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.056777:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185984 00000100:00100000:1.0:1788970250.056781:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185984 00000100:00100000:1.0:1788970250.056807:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186496 00000100:00100000:1.0:1788970250.056809:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186496 00000100:00100000:1.0:1788970250.056840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187008 00000100:00100000:1.0:1788970250.056843:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187008 00000100:00100000:1.0:1788970250.056857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970250.056864:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102185984:12345-0@lo:400: 00000100:00100000:1.0:1788970250.056904:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102185984:12345-0@lo:400: Request processed in 41us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.056910:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970250.056922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970250.056929:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102186496:12345-0@lo:400: 00000100:00100000:1.0:1788970250.056953:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102186496:12345-0@lo:400: Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.056958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970250.056968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788970250.056974:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102187008:12345-0@lo:400: 00000100:00100000:1.0:1788970250.056994:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102187008:12345-0@lo:400: Request processed in 21us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.057000:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788970250.057015:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788970250.057036:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf3770c0 x1875871102185984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.057047:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102185984:0@lo:400: 00010000:00080000:1.0:1788970250.057054:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf374f00 x1875871102186496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.057062:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102186496:0@lo:400: 00010000:00080000:1.0:1788970250.057069:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf375680 x1875871102187008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.057087:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102187008:0@lo:400: 00000100:00100000:0.0:1788970250.057372:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185600 00000100:00100000:0.0:1788970250.057377:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185600 00000100:00100000:1.0:1788970250.057444:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102186240:0@lo:400: 00000100:00100000:1.0:1788970250.057471:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.057492:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102186752:0@lo:400: 00000100:00100000:1.0:1788970250.057512:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.057532:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788970250.057537:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102186112:0@lo:400: 00000100:00100000:1.0:1788970250.057557:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.057576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102186624:0@lo:400: 00000100:00100000:1.0:1788970250.057596:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.057611:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102187136:0@lo:400: 00000100:00100000:1.0:1788970250.057635:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.057659:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186368 00000100:00100000:1.0:1788970250.057663:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186368 00000100:00100000:1.0:1788970250.057689:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186112 00000100:00100000:1.0:1788970250.057692:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186112 00000100:00100000:1.0:1788970250.057706:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788970250.057713:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102186368:12345-0@lo:400: 00000100:00100000:1.0:1788970250.057749:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102186368:12345-0@lo:400: Request processed in 37us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.057755:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788970250.057767:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970250.057773:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102186112:12345-0@lo:400: 00000100:00100000:1.0:1788970250.057802:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102186112:12345-0@lo:400: Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.057817:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970250.057833:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186240 00000100:00100000:1.0:1788970250.057836:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186240 00000100:00100000:1.0:1788970250.057850:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186624 00000100:00100000:1.0:1788970250.057852:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186624 00000100:00100000:1.0:1788970250.057868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187136 00000100:00100000:1.0:1788970250.057870:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187136 00000100:00100000:1.0:1788970250.057885:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788970250.057890:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d833892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102186240:12345-0@lo:400: 00000100:00100000:1.0:1788970250.057919:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d833892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102186240:12345-0@lo:400: Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.057924:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788970250.057933:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788970250.057938:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102186624:12345-0@lo:400: 00000100:00100000:1.0:1788970250.057961:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102186624:12345-0@lo:400: Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.057966:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788970250.057976:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788970250.057981:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102187136:12345-0@lo:400: 00000100:00100000:1.0:1788970250.058004:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102187136:12345-0@lo:400: Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.058009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788970250.058023:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970250.058042:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102186112:0@lo:400: 00010000:00080000:1.0:1788970250.058053:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377480 x1875871102186624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.058074:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102186624:0@lo:400: 00010000:00080000:1.0:1788970250.058085:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf374000 x1875871102187136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.058093:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102187136:0@lo:400: 00010000:00080000:1.0:1788970250.058102:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf376d00 x1875871102186240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.058110:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102186240:0@lo:400: 00000100:00100000:1.0:1788970250.058137:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102186368:0@lo:400: 00000100:00100000:1.0:1788970250.058153:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102185856 00000100:00100000:1.0:1788970250.058157:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102185856 00000100:00100000:0.0:1788970250.058459:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186880 00000100:00100000:0.0:1788970250.058463:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186880 00000100:00100000:0.0:1788970250.058484:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102186752 00000100:00100000:0.0:1788970250.058486:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102186752 00000100:00100000:0.0:1788970250.058500:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970250.058506:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83389680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102186880:12345-0@lo:400: 00000100:00100000:0.0:1788970250.058546:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83389680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102186880:12345-0@lo:400: Request processed in 41us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.058552:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970250.058565:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970250.058571:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102186752:12345-0@lo:400: 00000100:00100000:0.0:1788970250.058601:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102186752:12345-0@lo:400: Request processed in 30us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.058606:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970250.058617:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970250.058621:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102185600:12345-0@lo:8: 00010000:00080000:0.0:1788970250.058656:0:8689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1788970250.058683:0:8689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6e7d6 00002000:00100000:0.0:1788970250.058696:0:8689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a7d81a38800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788970250.058700:0:8689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788970250.058703:0:8689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788970250.058765:0:8689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970250.059003:0:8689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788970250.059031:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d81a3e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970250.059074:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102185600:12345-0@lo:8: Request processed in 451us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.059081:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788970250.059118:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788970250.059148:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83515a40 x1875871102185600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970250.059158:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970250.059164:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788970250.059172:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970250.059177:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788970250.059179:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf421000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970250.059460:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970250.059467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102185600:0@lo:8: 00010000:00080000:0.0:1788970250.059502:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf375e00 x1875871102186880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970250.059512:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102186880:0@lo:400: 00010000:00080000:0.0:1788970250.059536:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377c00 x1875871102186752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970250.059551:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102186752:0@lo:400: 00000100:00100000:1.0:1788970250.059622:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788970250.059634:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102185856:12345-0@lo:101: 00010000:00010000:1.0:1788970250.059645:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970250.059662:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e7cf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.059686:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.059696:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.059704:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4200, rc 0) 00000100:00100000:1.0:1788970250.059743:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102185856:12345-0@lo:101: Request processed in 113us (3632us total) trans 0 rc 0/0 00000004:00080000:2.0:1788970250.059811:0:9964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788970250.059873:0:9964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 269326491593ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788970250.059880:0:9964:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788970250.062484:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102187264:0@lo:700: 00000100:00100000:0.0:1788970250.062548:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.062578:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82163600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.062660:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187264 00000100:00100000:2.0:1788970250.062669:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187264 00000100:00100000:2.0:1788970250.062770:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970250.062779:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9966:x1875871102187264:12345-0@lo:700: 00000100:00100000:2.0:1788970250.062814:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8449:1875871102187392:0@lo:700: 00000100:00100000:2.0:1788970250.062844:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.062865:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12d80 going to sleep for 11 seconds 00000004:00080000:2.0:1788970250.064445:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:0.0:1788970250.064587:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970250.064687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788970250.064747:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102185856:0@lo:101: 00010000:00010000:1.0:1788970250.064771:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.064784:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.064854:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102187520:0@lo:501: 00000100:00100000:1.0:1788970250.064901:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.064970:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.064989:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187392 00000100:00100000:1.0:1788970250.064994:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187392 00000100:00100000:1.0:1788970250.065133:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970250.065143:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8449:x1875871102187392:12345-0@lo:700: 00000100:00100000:1.0:1788970250.065343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187520 00000100:00100000:1.0:1788970250.065348:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187520 00000100:00100000:0.0:1788970250.067579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788970250.067597:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102187520:12345-0@lo:501: 00000100:00100000:0.0:1788970250.067786:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102187520:12345-0@lo:501: Request processed in 195us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.067794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788970250.067983:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102187520:0@lo:501: 00000100:00100000:1.0:1788970250.068028:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102187648:0@lo:503: 00000100:00100000:1.0:1788970250.068078:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.069880:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.070149:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187648 00000100:00100000:3.0:1788970250.070158:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187648 00000100:00100000:3.0:1788970250.070199:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788970250.070207:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102187648:12345-0@lo:503: 00000100:00100000:3.0:1788970250.070447:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102187648:12345-0@lo:503: Request processed in 240us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.070456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788970250.070533:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102187648:0@lo:503: 00000100:00100000:3.0:1788970250.070934:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9968:1875871102187776:0@lo:502: 00000100:00100000:3.0:1788970250.070971:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.071157:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.071414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187776 00000100:00100000:1.0:1788970250.071421:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187776 00000100:00100000:2.0:1788970250.071568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788970250.071604:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:9968:x1875871102187776:12345-0@lo:502: 00000100:00100000:2.0:1788970250.071713:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:9968:x1875871102187776:12345-0@lo:502: Request processed in 138us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.071720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788970250.071874:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9968:1875871102187776:0@lo:502: 00000100:00100000:3.0:1788970250.071920:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9968:1875871102187904:0@lo:502: 00000100:00100000:3.0:1788970250.071956:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.071978:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.072079:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102187904 00000100:00100000:2.0:1788970250.072083:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102187904 00000100:00100000:2.0:1788970250.072104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788970250.072110:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:9968:x1875871102187904:12345-0@lo:502: 00000100:00100000:2.0:1788970250.072368:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:9968:x1875871102187904:12345-0@lo:502: Request processed in 256us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.072374:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 40000000:02000000:2.0:1788970250.072719:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788970250.079461:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9968:1875871102187904:0@lo:502: 00000040:00080000:3.0:1788970250.079562:0:9968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788970250.080451:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788970250.080491:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970250.080503:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080515:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970250.080525:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788970250.080528:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7eb0d2c000 from 6 10000000:01000000:3.0:1788970250.080532:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970250.080569:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080577:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080586:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970250.080606:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188032:0@lo:101: 00000100:00100000:3.0:1788970250.080661:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.080698:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.080717:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188032 00000100:00100000:3.0:1788970250.080723:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188032 00000100:00100000:3.0:1788970250.080766:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788970250.080775:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102188032:12345-0@lo:101: 00010000:00010000:3.0:1788970250.080787:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970250.080799:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c6e7eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e7e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080833:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c6e7eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7e4 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080843:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c6e7eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7e4 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080851:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ba00, rc 0) 00000100:00100000:3.0:1788970250.080887:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102188032:12345-0@lo:101: Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.080893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788970250.080934:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188032:0@lo:101: 00010000:00010000:3.0:1788970250.080948:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.080957:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970250.080996:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188160:0@lo:256: 00000100:00100000:3.0:1788970250.081023:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.081035:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.083364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188160 00000100:00100000:3.0:1788970250.083377:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188160 00000100:00100000:3.0:1788970250.083436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788970250.083445:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102188160:12345-0@lo:256: 20000000:01000000:3.0:1788970250.083468:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970250.083484:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970250.083487:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788970250.083603:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102188160:12345-0@lo:256: Request processed in 158us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.083611:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788970250.083663:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188160:0@lo:256: 10000000:01000000:3.0:1788970250.083717:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970250.083726:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.083737:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970250.083746:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788970250.083749:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788970250.083752:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788970250.083779:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.083787:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.083795:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970250.083810:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188288:0@lo:101: 00000100:00100000:3.0:1788970250.083837:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.083862:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.083873:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188288 00000100:00100000:3.0:1788970250.083877:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188288 00000100:00100000:3.0:1788970250.083897:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788970250.083903:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102188288:12345-0@lo:101: 00010000:00010000:3.0:1788970250.083916:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970250.083927:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e7f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.083945:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.083955:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.083963:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a800, rc 0) 00000100:00100000:3.0:1788970250.083990:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102188288:12345-0@lo:101: Request processed in 87us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.083996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788970250.084025:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188288:0@lo:101: 00010000:00010000:3.0:1788970250.084036:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.084044:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970250.084091:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188416:0@lo:501: 00000100:00100000:3.0:1788970250.084114:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.084126:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.084135:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188416 00000100:00100000:3.0:1788970250.084138:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188416 00000100:00100000:3.0:1788970250.084155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788970250.084161:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102188416:12345-0@lo:501: 00000100:00100000:2.0:1788970250.084916:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8449:x1875871102187392:12345-0@lo:700: Request processed in 19772us (22068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.084925:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788970250.084960:0:8449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83516580 x1875871102187392/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970250.084973:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8449:1875871102187392:0@lo:700: 40000000:02000000:2.0:1788970250.084982:0:8449:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788970250.086350:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102188416:12345-0@lo:501: Request processed in 2183us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.086362:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788970250.092376:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188416:0@lo:501: 00000100:00100000:1.0:1788970250.092461:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188544:0@lo:503: 00000100:00100000:1.0:1788970250.092541:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.092590:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.092616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188544 00000100:00100000:1.0:1788970250.092622:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188544 00000100:00100000:1.0:1788970250.092670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788970250.092678:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102188544:12345-0@lo:503: 00000100:00100000:1.0:1788970250.092792:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102188544:12345-0@lo:503: Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.092798:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788970250.092844:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102188544:0@lo:503: 00000100:00100000:0.0:1788970250.094596:0:9969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826db840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9969:1875871102188672:0@lo:502: 00000100:00100000:0.0:1788970250.094665:0:9969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.094707:0:9969:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82163cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.094755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188672 00000100:00100000:3.0:1788970250.094762:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188672 00000100:00100000:3.0:1788970250.094797:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788970250.094806:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:9969:x1875871102188672:12345-0@lo:502: 00000100:00100000:3.0:1788970250.094924:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:9969:x1875871102188672:12345-0@lo:502: Request processed in 119us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.094930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788970250.095001:0:9969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826db840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9969:1875871102188672:0@lo:502: 00000020:01000000:0.0:1788970250.095028:0:9969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970250.095036:0:9969:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788970250.095042:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970250.095045:0:9969:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788970250.095049:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970250.095053:0:9969:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:0.0:1788970250.095075:0:9969:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788970250.095078:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970250.095100:0:9969:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a7eae0919c0) 00000020:00000080:0.0:1788970250.095124:0:9969:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788970250.095130:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970250.095415:0:9969:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788970250.095425:0:9969:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788970250.095433:0:9969:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6e807 00010000:00080000:0.0:1788970250.095462:0:9969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d835f8000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970250.095715:0:9969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788970250.095836:0:9969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788970250.095846:0:9969:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788970250.095998:0:9969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970250.096106:0:9969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970250.097791:0:9969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788970250.097912:0:9969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788970250.099000:0:9970:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970250.099005:0:9970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1788970250.100035:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788970250.100156:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9966:x1875871102187264:12345-0@lo:700: Request processed in 37373us (37603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.100169:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788970250.100321:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d8f00 x1875871102187264/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970250.100336:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102187264:0@lo:700: 00000020:00000080:1.0:1788970250.100880:0:9969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970250.100892:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788970250.100929:0:9969:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788970250.100954:0:9969:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e80e 00000100:00080000:1.0:1788970250.100962:0:9969:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970250.100971:0:9969:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d835f8000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970250.100998:0:9969:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8338a580 x1875871102188800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970250.101023:0:9969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788970250.101076:0:9969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970250.101080:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970250.101082:0:9969:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788970250.101085:0:9969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970250.101088:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970250.101090:0:9969:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788970250.101092:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788970250.101094:0:9969:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788970250.101118:0:9969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9969:1875871102188928:0@lo:502: 00000100:00100000:1.0:1788970250.101195:0:9969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.101308:0:9969:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.101329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188928 00000100:00100000:1.0:1788970250.101336:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188928 00000100:00100000:1.0:1788970250.101407:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788970250.101417:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:9969:x1875871102188928:12345-0@lo:502: 00000100:00100000:1.0:1788970250.101524:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:9969:x1875871102188928:12345-0@lo:502: Request processed in 108us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.101532:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788970250.101577:0:9969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:9969:1875871102188928:0@lo:502: 00000020:01000000:1.0:1788970250.101599:0:9969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970250.101604:0:9969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970250.101605:0:9969:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788970250.101609:0:9969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788970250.101659:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788970250.101678:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788970250.101688:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.101700:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970250.101710:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788970250.101712:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7e848519c0 from 1 10000000:01000000:1.0:1788970250.101715:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788970250.101737:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.101745:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.101761:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.101774:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102189056:0@lo:101: 00000100:00100000:1.0:1788970250.101800:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.101813:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.101826:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189056 00000100:00100000:1.0:1788970250.101830:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189056 00000100:00100000:1.0:1788970250.101851:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788970250.101857:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102189056:12345-0@lo:101: 00010000:00010000:1.0:1788970250.101866:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970250.101878:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e815 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.101899:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.101910:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.101919:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5800, rc 0) 00000100:00100000:1.0:1788970250.101946:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102189056:12345-0@lo:101: Request processed in 89us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.101952:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788970250.101979:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102189056:0@lo:101: 00010000:00010000:1.0:1788970250.101989:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.102008:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.102048:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102189184:0@lo:501: 00000100:00100000:1.0:1788970250.102072:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.102084:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.102095:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189184 00000100:00100000:1.0:1788970250.102098:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189184 00000100:00100000:1.0:1788970250.102112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788970250.102117:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102189184:12345-0@lo:501: 00000100:00100000:1.0:1788970250.102172:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102189184:12345-0@lo:501: Request processed in 54us (99us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970250.102179:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788970250.102456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102188800:0@lo:8: 00000100:00100000:0.0:1788970250.102489:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.102518:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102188800 00000100:00100000:0.0:1788970250.102521:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102188800 00000100:00100000:0.0:1788970250.102539:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970250.102543:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102188800:12345-0@lo:8: 00010000:00080000:0.0:1788970250.102564:0:8689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1788970250.102589:0:8689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6e823 00002000:00100000:0.0:1788970250.102599:0:8689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a7d835fe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788970250.102602:0:8689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788970250.102605:0:8689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970250.102670:0:8689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788970250.102691:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d835fc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970250.102726:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102188800:12345-0@lo:8: Request processed in 181us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.102740:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788970250.102773:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338a580 x1875871102188800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970250.102781:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970250.102787:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788970250.102794:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970250.102799:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788970250.102801:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d835f8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970250.102823:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970250.102828:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102188800:0@lo:8: 00000004:00080000:2.0:1788970250.103151:0:9970:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788970250.104489:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102189184:0@lo:501: 10000000:01000000:1.0:1788970250.104532:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788970250.104541:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.104552:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970250.104922:0:9970:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 269371539301ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788970250.104929:0:9970:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788970250.105078:0:9971:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788970250.105102:0:9971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102189440:0@lo:7: 00000100:00100000:0.0:1788970250.105156:0:9971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.105209:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189440 00000100:00100000:0.0:1788970250.105216:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189440 00000100:00100000:0.0:1788970250.105273:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970250.105296:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9971:x1875871102189440:12345-0@lo:7: 00000100:00100000:1.0:1788970250.108557:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102189312:0@lo:13: 00000100:00100000:1.0:1788970250.108637:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.108693:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189312 00000100:00100000:1.0:1788970250.108701:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189312 00000100:00100000:1.0:1788970250.108743:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970250.108760:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102189312:12345-0@lo:13: 00002000:00000024:1.0:1788970250.108789:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:1.0:1788970250.108833:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102189312:12345-0@lo:13: Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.108841:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788970250.108881:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826db840 x1875871102189312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.108900:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102189312:0@lo:13: 00000100:00100000:2.0:1788970250.109360:0:9971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8448b3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788970250.109430:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788970250.109759:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788970250.109765:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788970250.109819:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9971:x1875871102189440:12345-0@lo:7: Request processed in 4537us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.109827:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788970250.109943:0:9971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d8b40 x1875871102189440/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970250.109955:0:9971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102189440:0@lo:7: 00000004:00080000:2.0:1788970250.109965:0:9971:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788970250.109994:0:9971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102189568:0@lo:5: 00000100:00100000:2.0:1788970250.110021:0:9971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.110041:0:9971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970250.111424:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189568 00000100:00100000:1.0:1788970250.111435:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189568 00000100:00100000:1.0:1788970250.111489:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970250.111498:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9971:x1875871102189568:12345-0@lo:5: 00002000:00080000:1.0:1788970250.111524:0:8689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788970250.111528:0:8689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:3.0:1788970250.112082:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788970250.114076:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102189696:0@lo:13: 00000100:00100000:3.0:1788970250.114149:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.114321:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189696 00000100:00100000:0.0:1788970250.114329:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189696 00000100:00100000:0.0:1788970250.114396:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970250.114406:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102189696:12345-0@lo:13: 00002000:00000024:0.0:1788970250.114441:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000004:00080000:1.0:1788970250.114565:0:9966:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788970250.114588:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102189824:0@lo:7: 00000100:00100000:1.0:1788970250.114615:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.114633:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.114720:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102189696:12345-0@lo:13: Request processed in 315us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.114728:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788970250.114787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf375e00 x1875871102189696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970250.114806:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102189696:0@lo:13: 00000100:00100000:3.0:1788970250.114834:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189824 00000100:00100000:3.0:1788970250.114838:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189824 00000100:00100000:3.0:1788970250.114900:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970250.114909:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9966:x1875871102189824:12345-0@lo:7: 00002000:00080000:2.0:1788970250.120135:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788970250.120143:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788970250.120680:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9966:x1875871102189824:12345-0@lo:7: Request processed in 5768us (6059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.120691:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788970250.120851:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377840 x1875871102189824/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970250.120865:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102189824:0@lo:7: 00000004:00080000:0.0:1788970250.120879:0:9966:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788970250.120919:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102189952:0@lo:5: 00000100:00100000:0.0:1788970250.120954:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.121015:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8448b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970250.121077:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102189952 00000100:00100000:2.0:1788970250.121083:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102189952 00000100:00100000:2.0:1788970250.121150:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970250.121160:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9966:x1875871102189952:12345-0@lo:5: 00002000:00080000:2.0:1788970250.121194:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788970250.121357:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9966:x1875871102189952:12345-0@lo:5: Request processed in 198us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.121363:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788970250.121477:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d9a40 x1875871102189952/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.121488:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102189952:0@lo:5: 00000004:00080000:1.0:1788970250.121495:0:9966:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788970250.121517:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102190080:0@lo:5: 00000100:00100000:1.0:1788970250.121539:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.121692:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d6a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.121746:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190080 00000100:00100000:0.0:1788970250.121751:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190080 00000100:00100000:0.0:1788970250.121772:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970250.121779:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9966:x1875871102190080:12345-0@lo:5: 00002000:00080000:0.0:1788970250.121801:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788970250.123799:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9966:x1875871102190080:12345-0@lo:5: Request processed in 2015us (2253us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788970250.123810:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788970250.124149:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf374000 x1875871102190080/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.124167:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1875871102190080:0@lo:5: 00000004:00080000:1.0:1788970250.124295:0:9966:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788970250.124543:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9966:1875871102190208:0@lo:900: 00000100:00100000:2.0:1788970250.124582:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.124647:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.124681:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190208 00000100:00100000:0.0:1788970250.124688:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190208 00000100:00100000:0.0:1788970250.124762:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970250.124772:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9966:x1875871102190208:12345-0@lo:900: 00000100:00100000:0.0:1788970250.124828:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9966:x1875871102190208:12345-0@lo:900: Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.124834:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788970250.124897:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83515680 x1875871102190208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970250.124908:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9966:1875871102190208:0@lo:900: 00000001:00080000:2.0:1788970250.134579:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1788970250.134597:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788970250.134604:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788970250.135726:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9971:x1875871102189568:12345-0@lo:5: Request processed in 24223us (25697us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788970250.135738:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788970250.136049:0:9971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83516580 x1875871102189568/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970250.136061:0:9971:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788970250.136067:0:9971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102189568:0@lo:5: 00000004:00080000:2.0:1788970250.136083:0:9971:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788970250.136128:0:9971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102190336:0@lo:700: 00000100:00100000:2.0:1788970250.136164:0:9971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.136453:0:9971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970250.136516:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190336 00000100:00100000:3.0:1788970250.136523:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190336 00000100:00100000:3.0:1788970250.136578:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970250.136587:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83515680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9971:x1875871102190336:12345-0@lo:700: 00000100:00100000:2.0:1788970250.155864:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83515680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9971:x1875871102190336:12345-0@lo:700: Request processed in 19271us (19693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970250.155879:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788970250.156880:0:9971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83516580 x1875871102190336/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970250.156909:0:9971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102190336:0@lo:700: 00000004:02000040:2.0:1788970250.173940:0:9971:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788970250.176724:0:9971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835161c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102190464:0@lo:5: 00000100:00100000:2.0:1788970250.176789:0:9971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.176851:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190464 00000100:00100000:2.0:1788970250.176857:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190464 00000100:00100000:2.0:1788970250.176929:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970250.176938:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9971:x1875871102190464:12345-0@lo:5: 00000100:00100000:3.0:1788970250.194495:0:9971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7cc0 going to sleep for 11 seconds 00002000:00080000:2.0:1788970250.197617:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788970250.197642:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788970250.204573:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9971:x1875871102190464:12345-0@lo:5: Request processed in 27627us (27775us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788970250.204587:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788970250.204673:0:9971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835161c0 x1875871102190464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970250.204691:0:9971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835161c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9971:1875871102190464:0@lo:5: 00000004:00080000:3.0:1788970250.204705:0:9971:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788970250.270491:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788970250.291823:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1788970251.292603:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970251.548598:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102190592:0@lo:13: 00000100:00100000:3.0:1788970251.548667:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970251.549114:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970251.549128:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102190720:0@lo:13: 00000100:00100000:1.0:1788970251.549158:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970251.549359:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190592 00000100:00100000:0.0:1788970251.549368:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190592 00000100:00100000:0.0:1788970251.549427:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190720 00000100:00100000:0.0:1788970251.549430:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190720 00000100:00100000:0.0:1788970251.549447:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970251.549456:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102190592:12345-0@lo:13: 00002000:00000024:0.0:1788970251.549484:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970251.551032:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102190592:12345-0@lo:13: Request processed in 1570us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970251.551054:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970251.551082:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970251.551093:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102190720:12345-0@lo:13: 00002000:00000024:0.0:1788970251.551115:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970251.551179:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102190720:12345-0@lo:13: Request processed in 85us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970251.551185:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788970251.551425:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf374b40 x1875871102190720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970251.551446:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102190720:0@lo:13: 00010000:00080000:3.0:1788970251.551598:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d8000 x1875871102190592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970251.551611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102190592:0@lo:13: 00000020:00000004:1.0:1788970252.152278:0:10042:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970252.152827:0:10042:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788970252.321709:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970252.572571:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970252.572600:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102190848:0@lo:41: 00000100:00100000:0.0:1788970252.572665:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970252.572944:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190848 00000100:00100000:1.0:1788970252.572953:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190848 00000100:00100000:1.0:1788970252.573010:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970252.573020:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102190848:12345-0@lo:41: 00000004:00000024:1.0:1788970252.573056:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788970252.573862:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102190848:12345-0@lo:41: Request processed in 841us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970252.573870:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970252.575992:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102190848:0@lo:41: 00000020:00000004:3.0:1788970253.039961:0:10090:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970253.039972:0:10090:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788970253.340597:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970253.554891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970253.555035:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082217600 00000100:00100000:1.0:1788970253.555049:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082217600 00000100:00100000:1.0:1788970253.555114:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:1.0:1788970253.555125:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1875871082217600:12345-192.168.203.15@tcp:250: 00010000:00080000:1.0:1788970253.555165:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from aaba251a-cf52-4613-ab47-fccc9a1d3dd9@192.168.203.15@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1788970253.555216:0:6517:0:(genops.c:1384:class_connect()) connect: client aaba251a-cf52-4613-ab47-fccc9a1d3dd9, cookie 0xc3abfebe76c6e82a 00000100:00080000:1.0:1788970253.555464:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8a7d83521800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970253.555566:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+5:2399:x1875871082217600:12345-192.168.203.15@tcp:250: Request processed in 440us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970253.555591:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:0.0:1788970253.570977:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970253.571920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082217728 00000100:00100000:3.0:1788970253.571932:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082217728 00000100:00100000:3.0:1788970253.571994:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:3.0:1788970253.572005:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+5:6160:x1875871082217728:12345-192.168.203.15@tcp:101: 00010000:00010000:3.0:1788970253.572022:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970253.572040:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970253.572069:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970253.572095:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970253.572104:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a600, rc 0) 00000100:00100000:3.0:1788970253.572169:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+6:6160:x1875871082217728:12345-192.168.203.15@tcp:101: Request processed in 166us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970253.572176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:3.0:1788970253.594878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970253.595066:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082217856 00000100:00100000:2.0:1788970253.595082:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082217856 00000100:00100000:2.0:1788970253.595170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:2.0:1788970253.595184:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+6:6160:x1875871082217856:12345-192.168.203.15@tcp:501: 00000100:00100000:2.0:1788970253.595369:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+6:6160:x1875871082217856:12345-192.168.203.15@tcp:501: Request processed in 188us (508us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970253.595378:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:2.0:1788970253.603241:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970253.603737:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082217984 00000100:00100000:1.0:1788970253.603753:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082217984 00000100:00100000:1.0:1788970253.603882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:1.0:1788970253.603896:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+6:6160:x1875871082217984:12345-192.168.203.15@tcp:101: 00010000:00010000:1.0:1788970253.603919:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970253.603944:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d60f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.603984:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.603997:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.604008:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654c00, rc 0) 00000100:00100000:1.0:1788970253.604105:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+7:6160:x1875871082217984:12345-192.168.203.15@tcp:101: Request processed in 212us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970253.604113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:0.0:1788970253.610636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970253.610742:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218112 00000100:00100000:3.0:1788970253.610753:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218112 00000100:00100000:3.0:1788970253.610815:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:3.0:1788970253.610825:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+7:6160:x1875871082218112:12345-192.168.203.15@tcp:501: 00000100:00100000:3.0:1788970253.610993:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6160:x1875871082218112:12345-192.168.203.15@tcp:501: Request processed in 168us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970253.611001:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:3.0:1788970253.613937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970253.614911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218240 00000100:00100000:1.0:1788970253.614921:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218240 00000100:00100000:1.0:1788970253.614986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:1.0:1788970253.614996:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6160:x1875871082218240:12345-192.168.203.15@tcp:503: 00000100:00100000:1.0:1788970253.615150:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6160:x1875871082218240:12345-192.168.203.15@tcp:503: Request processed in 154us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970253.615680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:1.0:1788970253.619107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970253.619267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218368 00000100:00100000:2.0:1788970253.619278:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218368 00000100:00100000:2.0:1788970253.619342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:2.0:1788970253.619353:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6179:x1875871082218368:12345-192.168.203.15@tcp:502: 00000100:00100000:2.0:1788970253.619544:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6179:x1875871082218368:12345-192.168.203.15@tcp:502: Request processed in 192us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970253.619552:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:0.0:1788970253.663664:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970253.668116:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218496 00000100:00100000:3.0:1788970253.668134:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218496 00000100:00100000:3.0:1788970253.668483:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:3.0:1788970253.668495:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6179:x1875871082218496:12345-192.168.203.15@tcp:502: 00000100:00100000:3.0:1788970253.668678:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6179:x1875871082218496:12345-192.168.203.15@tcp:502: Request processed in 184us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970253.668686:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:3.0:1788970253.671705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970253.673611:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218624 00000100:00100000:1.0:1788970253.673625:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218624 00000100:00100000:1.0:1788970253.673695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:1.0:1788970253.673706:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6160:x1875871082218624:12345-192.168.203.15@tcp:101: 00010000:00010000:1.0:1788970253.673731:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970253.673749:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6e83f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d640 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.673778:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6e83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d640 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.673790:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6e83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d640 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.673798:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655800, rc 0) 00000100:00100000:1.0:1788970253.673975:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6160:x1875871082218624:12345-192.168.203.15@tcp:101: Request processed in 270us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970253.673982:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:1.0:1788970253.681677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970253.681858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218752 00000100:00100000:3.0:1788970253.681882:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218752 00000100:00100000:3.0:1788970253.681939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:3.0:1788970253.681948:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6160:x1875871082218752:12345-192.168.203.15@tcp:256: 20000000:01000000:3.0:1788970253.681974:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788970253.681992:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788970253.681996:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788970253.681999:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788970253.682002:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788970253.682004:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788970253.685222:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6160:x1875871082218752:12345-192.168.203.15@tcp:256: Request processed in 3264us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970253.685236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:0.0:1788970253.692696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970253.692849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082218880 00000100:00100000:1.0:1788970253.692859:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082218880 00000100:00100000:1.0:1788970253.692917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:1.0:1788970253.692928:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6160:x1875871082218880:12345-192.168.203.15@tcp:101: 00010000:00010000:1.0:1788970253.692946:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970253.692962:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d647 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.692991:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.693021:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970253.693031:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654a00, rc 0) 00000100:00100000:1.0:1788970253.693091:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6160:x1875871082218880:12345-192.168.203.15@tcp:101: Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970253.693098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:1.0:1788970253.696286:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970253.697920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219008 00000100:00100000:3.0:1788970253.697934:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219008 00000100:00100000:2.0:1788970253.698863:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:2.0:1788970253.698875:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6160:x1875871082219008:12345-192.168.203.15@tcp:501: 00000100:00100000:2.0:1788970253.699045:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6160:x1875871082219008:12345-192.168.203.15@tcp:501: Request processed in 172us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970253.699061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:0.0:1788970253.701320:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970253.702976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219136 00000100:00100000:2.0:1788970253.702990:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219136 00000100:00100000:2.0:1788970253.703505:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:2.0:1788970253.703519:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6160:x1875871082219136:12345-192.168.203.15@tcp:503: 00000100:00100000:2.0:1788970253.703687:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6160:x1875871082219136:12345-192.168.203.15@tcp:503: Request processed in 171us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970253.707015:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970253.708009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:2.0:1788970253.708215:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219264 00000100:00100000:2.0:1788970253.708225:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219264 00000100:00100000:1.0:1788970253.708347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:1.0:1788970253.708362:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6185:x1875871082219264:12345-192.168.203.15@tcp:502: 00000100:00100000:1.0:1788970253.708599:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6185:x1875871082219264:12345-192.168.203.15@tcp:502: Request processed in 240us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970253.708902:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:0.0:1788970253.711899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970253.711997:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219392 00000100:00100000:3.0:1788970253.712007:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219392 00000100:00100000:3.0:1788970253.712064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:3.0:1788970253.712073:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6185:x1875871082219392:12345-192.168.203.15@tcp:502: 00000100:00100000:3.0:1788970253.712653:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6185:x1875871082219392:12345-192.168.203.15@tcp:502: Request processed in 578us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970253.712661:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:0.0:1788970253.715551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970253.715650:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219520 00000100:00100000:1.0:1788970253.715661:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219520 00000100:00100000:1.0:1788970253.715721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:1.0:1788970253.715738:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875871082219520:12345-192.168.203.15@tcp:38: 00010000:00080000:1.0:1788970253.715772:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1788970253.715911:0:6524:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6e84d 00000004:00100000:1.0:1788970253.715937:0:6524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788970253.717278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00080000:0.0:1788970253.717417:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970253.717503:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082219520:12345-192.168.203.15@tcp:38: Request processed in 1764us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970253.717514:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1788970253.717550:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219776 00000100:00100000:0.0:1788970253.717559:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219776 00000100:00100000:0.0:1788970253.717601:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1788970253.717607:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875871082219776:12345-192.168.203.15@tcp:38: 00010000:00080000:0.0:1788970253.717635:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:0.0:1788970253.717688:0:6524:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6e854 00000004:00100000:0.0:1788970253.717712:0:6524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788970253.718375:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970253.718455:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082219776:12345-192.168.203.15@tcp:38: Request processed in 845us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970253.718463:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:3.0:1788970254.108810:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102190976:0@lo:41: 00000100:00100000:3.0:1788970254.108883:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970254.109013:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102190976 00000100:00100000:0.0:1788970254.109020:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102190976 00000100:00100000:0.0:1788970254.109073:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788970254.109082:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102190976:12345-0@lo:41: 00000004:00000024:0.0:1788970254.109115:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970254.109359:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102190976:12345-0@lo:41: Request processed in 276us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970254.109368:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788970254.109472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102190976:0@lo:41: 00010000:00010000:3.0:1788970254.364665:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970254.725150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970254.725623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219904 00000100:00100000:2.0:1788970254.725633:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219904 00000100:00100000:2.0:1788970254.725717:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1788970254.725728:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082219904:12345-192.168.203.15@tcp:41: 00000100:00080000:0.0:1788970254.725761:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1788970254.725762:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788970254.725883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970254.725996:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970254.726020:0:6526:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788970254.726075:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082219904:12345-192.168.203.15@tcp:41: Request processed in 347us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970254.726088:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1788970254.726212:0:6526:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788970254.726735:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220032 00000100:00100000:2.0:1788970254.726742:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220032 00000100:00100000:2.0:1788970254.726778:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082219648 00000100:00100000:2.0:1788970254.726791:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082219648 00000100:00100000:2.0:1788970254.726807:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970254.726821:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:6160:x1875871082220032:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1788970254.726844:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788970254.726879:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:6160:x1875871082220032:12345-192.168.203.15@tcp:41: Request processed in 59us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970254.726885:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970254.726898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1788970254.726904:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082219648:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1788970254.726914:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788970254.726934:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082219648:12345-192.168.203.15@tcp:41: Request processed in 30us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970254.726939:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00080000:1.0:1788970254.727056:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970254.730668:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970254.731095:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220160 00000100:00100000:2.0:1788970254.731110:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220160 00000100:00100000:2.0:1788970254.731195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1788970254.731208:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6160:x1875871082220160:12345-192.168.203.15@tcp:40: 00000100:00100000:2.0:1788970254.731348:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6160:x1875871082220160:12345-192.168.203.15@tcp:40: Request processed in 142us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970254.731356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1788970254.734752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970254.734867:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970254.735257:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220544 00000100:00100000:1.0:1788970254.735272:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220544 00000100:00100000:1.0:1788970254.735350:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:1.0:1788970254.735364:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2401:x1875871082220544:12345-192.168.203.15@tcp:400: 00000100:00100000:2.0:1788970254.735409:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220288 00000100:00100000:2.0:1788970254.735415:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220288 00000100:00100000:2.0:1788970254.735455:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:2.0:1788970254.735463:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875871082220288:12345-192.168.203.15@tcp:8: 00010000:00080000:2.0:1788970254.735501:0:8441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 274 last 0 00000100:00100000:1.0:1788970254.735514:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2401:x1875871082220544:12345-192.168.203.15@tcp:400: Request processed in 153us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970254.735523:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 195 00000020:00000080:2.0:1788970254.735554:0:8441:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6e85b 00002000:00100000:2.0:1788970254.735570:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76727560-d4e0-4213-a4e0-b609fd69db0f/ffff8a7ebf424000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970254.735617:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788970254.735876:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788970254.735911:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf423000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970254.735977:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082220288:12345-192.168.203.15@tcp:8: Request processed in 512us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970254.735985:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1788970254.737611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970254.737713:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220416 00000100:00100000:0.0:1788970254.737726:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220416 00000100:00100000:0.0:1788970254.737783:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970254.737793:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082220416:12345-192.168.203.15@tcp:8: 00010000:00080000:0.0:1788970254.737839:0:8442:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1788970254.737878:0:8442:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6e862 00002000:00100000:0.0:1788970254.737892:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76727560-d4e0-4213-a4e0-b609fd69db0f/ffff8a7ebf3b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970254.737915:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788970254.738133:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788970254.738187:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970254.738282:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082220416:12345-192.168.203.15@tcp:8: Request processed in 489us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970254.738291:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1788970254.739082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970254.739174:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220672 00000100:00100000:3.0:1788970254.739183:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220672 00000100:00100000:3.0:1788970254.739238:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:3.0:1788970254.739248:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6160:x1875871082220672:12345-192.168.203.15@tcp:900: 00000100:00100000:3.0:1788970254.739473:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6160:x1875871082220672:12345-192.168.203.15@tcp:900: Request processed in 227us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970254.739481:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1788970254.744095:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970254.744290:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220800 00000100:00100000:0.0:1788970254.744304:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220800 00000100:00100000:0.0:1788970254.744475:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970254.744489:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6160:x1875871082220800:12345-192.168.203.15@tcp:33: 00000004:00080000:1.0:1788970254.788361:0:6527:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43730us 00000004:00200000:1.0:1788970254.800047:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788970254.800168:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6160:x1875871082220800:12345-192.168.203.15@tcp:33: Request processed in 55678us (56083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970254.800184:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:1.0:1788970255.005486:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970255.007288:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082220928 00000100:00100000:2.0:1788970255.007302:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082220928 00000100:00100000:2.0:1788970255.007377:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:2.0:1788970255.007434:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6203:x1875871082220928:12345-192.168.203.15@tcp:101: 00010000:00010000:2.0:1788970255.007456:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970255.007531:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c6e869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d678 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970255.007604:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6e870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970255.007618:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6e870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970255.007631:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6e870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970255.007678:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970255.007681:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970255.007696:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6e870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970255.007724:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c6e869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d678 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970255.007758:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6e870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d678 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970255.007765:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e9700) 00010000:00010000:2.0:1788970255.007768:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970255.007771:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98600, rc 0) 00000100:00100000:2.0:1788970255.009140:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:6203:x1875871082220928:12345-192.168.203.15@tcp:101: Request processed in 1703us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970255.009159:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1788970255.132958:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102191360:0@lo:400: 00000100:00100000:1.0:1788970255.133028:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133086:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102191872:0@lo:400: 00000100:00100000:1.0:1788970255.133111:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133130:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102192384:0@lo:400: 00000100:00100000:1.0:1788970255.133148:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133169:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788970255.133175:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102191232:0@lo:400: 00000100:00100000:1.0:1788970255.133196:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133211:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102191744:0@lo:400: 00000100:00100000:1.0:1788970255.133243:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133279:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102192256:0@lo:400: 00000100:00100000:1.0:1788970255.133300:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133326:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191360 00000100:00100000:1.0:1788970255.133333:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191360 00000100:00100000:1.0:1788970255.133402:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970255.133413:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102191360:12345-0@lo:400: 00000100:00100000:1.0:1788970255.133466:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102191360:12345-0@lo:400: Request processed in 54us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.133473:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970255.133496:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191872 00000100:00100000:1.0:1788970255.133499:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191872 00000100:00100000:1.0:1788970255.133525:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192384 00000100:00100000:1.0:1788970255.133529:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192384 00000100:00100000:1.0:1788970255.133545:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191232 00000100:00100000:1.0:1788970255.133548:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191232 00000100:00100000:2.0:1788970255.133553:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102191104:0@lo:400: 00000100:00100000:1.0:1788970255.133562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191744 00000100:00100000:1.0:1788970255.133567:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191744 00000100:00100000:1.0:1788970255.133583:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192256 00000100:00100000:1.0:1788970255.133586:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192256 00000100:00100000:2.0:1788970255.133596:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133607:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788970255.133627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102191616:0@lo:400: 00000100:00100000:2.0:1788970255.133651:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970255.133672:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102192128:0@lo:400: 00000100:00100000:2.0:1788970255.133697:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.133769:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102191872:12345-0@lo:400: 00000100:00100000:1.0:1788970255.133817:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5827840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102191872:12345-0@lo:400: Request processed in 204us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.133824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970255.133837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970255.133843:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102192384:12345-0@lo:400: 00000100:00100000:1.0:1788970255.133868:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102192384:12345-0@lo:400: Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.133882:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970255.133896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970255.133902:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102191232:12345-0@lo:400: 00000100:00100000:1.0:1788970255.133930:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102191232:12345-0@lo:400: Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.133936:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970255.133947:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788970255.133954:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102191744:12345-0@lo:400: 00000100:00100000:1.0:1788970255.133985:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5825a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102191744:12345-0@lo:400: Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970255.133991:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102192640:0@lo:400: 00000100:00100000:1.0:1788970255.133992:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788970255.134014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788970255.134022:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102192256:12345-0@lo:400: 00000100:00100000:2.0:1788970255.134033:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.134072:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102192256:12345-0@lo:400: Request processed in 49us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970255.134075:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788970255.134082:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788970255.134089:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102191488:0@lo:400: 00000100:00100000:1.0:1788970255.134118:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191616 00000100:00100000:3.0:1788970255.134122:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102192768:0@lo:13: 00000100:00100000:2.0:1788970255.134124:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.134125:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191616 00000100:00100000:1.0:1788970255.134163:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788970255.134164:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102192000:0@lo:400: 00000100:00100000:1.0:1788970255.134175:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102191616:12345-0@lo:400: 00000100:00100000:3.0:1788970255.134208:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970255.134220:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.134226:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102191616:12345-0@lo:400: Request processed in 51us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.134234:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788970255.134351:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192128 00000100:00100000:0.0:1788970255.134356:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192128 00000100:00100000:0.0:1788970255.134403:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192640 00000100:00100000:0.0:1788970255.134407:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192640 00000100:00100000:0.0:1788970255.134421:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192000 00000100:00100000:0.0:1788970255.134423:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192000 00000100:00100000:0.0:1788970255.134447:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970255.134453:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102192128:12345-0@lo:400: 00000100:00080000:1.0:1788970255.134727:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970255.134732:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970255.134734:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970255.134743:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970255.134775:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102191232:0@lo:400: 00000100:00100000:1.0:1788970255.134787:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102191744:0@lo:400: 00000100:00100000:1.0:1788970255.134797:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102192256:0@lo:400: 00000100:00100000:1.0:1788970255.134806:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102191360:0@lo:400: 00010000:00080000:1.0:1788970255.134818:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7e898ff840 x1875871102191872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970255.134828:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102191872:0@lo:400: 00010000:00080000:1.0:1788970255.134838:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5827480 x1875871102192384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970255.134847:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102192384:0@lo:400: 00000100:00100000:1.0:1788970255.134896:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970255.134904:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102192640:12345-0@lo:400: 00000100:00100000:2.0:1788970255.135653:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5827c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102192512:0@lo:400: 00000100:00100000:2.0:1788970255.135692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970255.135731:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102191616:0@lo:400: 00000100:00100000:2.0:1788970255.135799:0:8689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788970255.135807:0:8689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788970255.135890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191488 00000100:00100000:2.0:1788970255.135894:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191488 00000100:00100000:2.0:1788970255.135939:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970255.135946:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102191488:12345-0@lo:400: 00000100:00100000:2.0:1788970255.135989:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102191488:12345-0@lo:400: Request processed in 43us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970255.135995:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970255.136023:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102192896:0@lo:13: 00000100:00100000:2.0:1788970255.136054:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970255.136318:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102191104 00000100:00100000:3.0:1788970255.136332:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102191104 00000100:00100000:3.0:1788970255.137647:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788970255.137669:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102191104:12345-0@lo:400: 00000100:00100000:2.0:1788970255.137850:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102191488:0@lo:400: 00000100:00100000:3.0:1788970255.137851:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102191104:12345-0@lo:400: Request processed in 189us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970255.137876:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788970255.137888:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102191104:0@lo:400: 00000100:00100000:2.0:1788970255.137938:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788970255.137950:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192512 00000100:00100000:2.0:1788970255.137956:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192512 00000100:00100000:3.0:1788970255.138006:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192768 00000100:00100000:2.0:1788970255.138009:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788970255.138015:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192768 00000100:00100000:2.0:1788970255.138021:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970255.138031:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102192000:12345-0@lo:400: 00000100:00100000:2.0:1788970255.138098:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102192000:12345-0@lo:400: Request processed in 68us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970255.138103:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970255.138119:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788970255.138124:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970255.138130:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102192512:12345-0@lo:400: 00000100:00100000:2.0:1788970255.138159:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102192512:12345-0@lo:400: Request processed in 29us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970255.138177:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788970255.138210:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7e898fc780 x1875871102192000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970255.138222:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102192000:0@lo:400: 00010000:00080000:2.0:1788970255.138233:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5827c00 x1875871102192512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970255.138239:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788970255.138290:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102192896 00000100:00100000:3.0:1788970255.138298:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102192896 00000100:00100000:3.0:1788970255.138324:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970255.138332:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102192768:12345-0@lo:13: 00002000:00000024:3.0:1788970255.138353:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970255.138629:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102192768:12345-0@lo:13: Request processed in 297us (4424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970255.138653:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970255.138669:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970255.139013:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102192896:12345-0@lo:13: 00002000:00000024:3.0:1788970255.139027:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970255.139144:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5827c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102192512:0@lo:400: 00010000:00080000:2.0:1788970255.139375:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276de00 x1875871102192768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970255.139414:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788970255.139431:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102192768:0@lo:13: 00000100:00080000:2.0:1788970255.139485:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970255.139657:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102192896:12345-0@lo:13: Request processed in 646us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970255.139667:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788970255.139907:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835170c0 x1875871102192896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970255.139939:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102192896:0@lo:13: 00000100:00100000:0.0:1788970255.141522:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102192128:12345-0@lo:400: Request processed in 7060us (7816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970255.141539:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788970255.141583:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7e8949f0c0 x1875871102192128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970255.141604:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102192128:0@lo:400: 00000100:00100000:1.0:1788970255.151837:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102192640:12345-0@lo:400: Request processed in 16924us (17795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.151853:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788970255.151942:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5824f00 x1875871102192640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970255.151965:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102192640:0@lo:400: 00010000:00010000:0.0:1788970255.388770:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970256.413002:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970256.669016:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102193024:0@lo:13: 00000100:00100000:3.0:1788970256.669086:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970256.669213:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193024 00000100:00100000:1.0:1788970256.669222:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193024 00000100:00100000:1.0:1788970256.669288:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970256.669298:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102193024:12345-0@lo:13: 00002000:00000024:1.0:1788970256.669320:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970256.669367:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102193024:12345-0@lo:13: Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970256.669374:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788970256.669557:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5827480 x1875871102193024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970256.669577:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102193024:0@lo:13: 00000100:00100000:3.0:1788970256.671101:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970256.671262:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102193152:0@lo:13: 00000100:00100000:3.0:1788970256.671320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970256.672067:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193152 00000100:00100000:1.0:1788970256.672077:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193152 00000100:00100000:1.0:1788970256.672186:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970256.672198:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102193152:12345-0@lo:13: 00002000:00000024:1.0:1788970256.672219:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788970256.676034:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d8000 x1875871102193152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970256.676064:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102193152:0@lo:13: 00000100:00100000:1.0:1788970256.677763:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102193152:12345-0@lo:13: Request processed in 5560us (6436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970256.677777:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788970256.785634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970256.785789:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221056 00000100:00100000:2.0:1788970256.785823:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221056 00000100:00100000:2.0:1788970256.785902:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:2.0:1788970256.785912:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:6255:x1875871082221056:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1788970256.785951:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788970256.786026:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:6255:x1875871082221056:12345-192.168.203.15@tcp:41: Request processed in 115us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970256.786033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00080000:1.0:1788970256.786540:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970256.788198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970256.788328:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221184 00000100:00100000:2.0:1788970256.788337:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221184 00000100:00100000:2.0:1788970256.788433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:2.0:1788970256.788444:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6255:x1875871082221184:12345-192.168.203.15@tcp:41: 00000004:00000024:2.0:1788970256.788482:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970256.788549:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6255:x1875871082221184:12345-192.168.203.15@tcp:41: Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970256.788556:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00080000:1.0:1788970256.789013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970256.791571:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970256.791673:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221312 00000100:00100000:3.0:1788970256.791686:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221312 00000100:00100000:3.0:1788970256.791800:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970256.791813:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6255:x1875871082221312:12345-192.168.203.15@tcp:13: 00002000:00000024:3.0:1788970256.791856:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970256.791947:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6255:x1875871082221312:12345-192.168.203.15@tcp:13: Request processed in 136us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970256.791954:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00080000:1.0:1788970256.792123:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970256.797081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970256.797297:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221440 00000100:00100000:3.0:1788970256.797311:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221440 00000100:00080000:1.0:1788970256.797466:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970256.797547:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:3.0:1788970256.797560:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6255:x1875871082221440:12345-192.168.203.15@tcp:13: 00002000:00000024:3.0:1788970256.797604:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970256.797696:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76727560-d4e0-4213-a4e0-b609fd69db0f+6:6255:x1875871082221440:12345-192.168.203.15@tcp:13: Request processed in 138us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970256.797705:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00010000:00010000:0.0:1788970257.439573:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970257.692789:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102193280:0@lo:41: 00000100:00100000:3.0:1788970257.692875:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970257.692994:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193280 00000100:00100000:3.0:1788970257.693003:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193280 00000100:00100000:3.0:1788970257.693060:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788970257.693072:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102193280:12345-0@lo:41: 00000004:00000024:3.0:1788970257.693100:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788970257.693156:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102193280:12345-0@lo:41: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970257.693164:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788970257.693259:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102193280:0@lo:41: 00010000:00010000:3.0:1788970258.461187:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788970258.724339:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000100:00100000:3.0:1788970259.233820:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102193408:0@lo:41: 00000100:00100000:3.0:1788970259.233923:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970259.234105:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193408 00000100:00100000:1.0:1788970259.234128:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193408 00000100:00100000:1.0:1788970259.234208:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970259.234229:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102193408:12345-0@lo:41: 00000004:00000024:1.0:1788970259.234277:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788970259.249618:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102193408:12345-0@lo:41: Request processed in 15384us (15679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970259.249639:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970259.251696:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102193408:0@lo:41: 00000001:02000400:0.0:1788970259.386049:0:10190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788970259.484980:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788970259.745997:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000001:00100000:3.0:1788970259.746087:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000100:00100000:0.0:1788970260.174327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970260.174478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970260.174550:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970260.174633:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970260.174652:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222080 00000100:00100000:1.0:1788970260.174668:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222080 00000100:00100000:0.0:1788970260.174676:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970260.174754:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221952 00000100:00100000:1.0:1788970260.174759:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221952 00000100:00100000:1.0:1788970260.174790:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1788970260.174795:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221568 00000100:00100000:1.0:1788970260.174804:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082222080:12345-192.168.203.15@tcp:400: 00000100:00100000:3.0:1788970260.174808:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221568 00000100:00100000:1.0:1788970260.174881:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082222080:12345-192.168.203.15@tcp:400: Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970260.174941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:3.0:1788970260.174971:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082221568:12345-192.168.203.15@tcp:400: 00000100:00100000:1.0:1788970260.175035:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:1.0:1788970260.175059:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:1.0:1788970260.175069:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82549e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082221952:12345-192.168.203.15@tcp:400: 00000100:00100000:3.0:1788970260.175094:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082221568:12345-192.168.203.15@tcp:400: Request processed in 123us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970260.175109:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82549e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082221952:12345-192.168.203.15@tcp:400: Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970260.175124:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:1.0:1788970260.175129:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00080000:1.0:1788970260.175148:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970260.175154:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970260.175226:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221824 00000100:00100000:3.0:1788970260.175250:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221824 00000100:00080000:1.0:1788970260.175325:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970260.175328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082221696 00000100:00100000:3.0:1788970260.175334:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082221696 00000100:00100000:1.0:1788970260.175354:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:3.0:1788970260.175482:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:3.0:1788970260.175507:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082221696:12345-192.168.203.15@tcp:400: 00000100:00100000:3.0:1788970260.175595:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082221696:12345-192.168.203.15@tcp:400: Request processed in 78us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970260.175603:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00080000:3.0:1788970260.175723:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970260.176149:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082221824:12345-192.168.203.15@tcp:400: 00000100:00100000:3.0:1788970260.176462:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082221824:12345-192.168.203.15@tcp:400: Request processed in 1004us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970260.176472:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1788970260.255652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102193536:0@lo:400: 00000100:00100000:2.0:1788970260.255722:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.255768:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102194048:0@lo:400: 00000100:00100000:2.0:1788970260.255791:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.255810:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102194560:0@lo:400: 00000100:00100000:2.0:1788970260.255829:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.255843:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102195072:0@lo:400: 00000100:00100000:2.0:1788970260.255865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.255889:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788970260.255902:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102193664:0@lo:400: 00000100:00100000:2.0:1788970260.255928:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.255948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102194176:0@lo:400: 00000100:00100000:2.0:1788970260.255968:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.255986:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102194688:0@lo:400: 00000100:00100000:2.0:1788970260.256005:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256023:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102195200:0@lo:13: 00000100:00100000:2.0:1788970260.256044:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256076:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102193792:0@lo:400: 00000100:00100000:2.0:1788970260.256097:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256115:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102194304:0@lo:400: 00000100:00100000:2.0:1788970260.256134:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256150:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102194816:0@lo:400: 00000100:00100000:2.0:1788970260.256174:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256186:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788970260.256400:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194560 00000100:00100000:1.0:1788970260.256408:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194560 00000100:00100000:1.0:1788970260.256465:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102195072 00000100:00100000:1.0:1788970260.256469:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102195072 00000100:00100000:1.0:1788970260.256493:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970260.256502:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102194560:12345-0@lo:400: 00000100:00100000:1.0:1788970260.256557:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102194560:12345-0@lo:400: Request processed in 56us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970260.256564:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970260.256582:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788970260.256588:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102195072:12345-0@lo:400: 00000100:00100000:1.0:1788970260.256617:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102195072:12345-0@lo:400: Request processed in 29us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970260.256623:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788970260.256649:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970260.256653:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970260.256685:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366cb40 x1875871102194560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.256700:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102194560:0@lo:400: 00010000:00080000:1.0:1788970260.256712:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366e580 x1875871102195072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.256720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102195072:0@lo:400: 00000100:00100000:2.0:1788970260.256871:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102193920:0@lo:400: 00000100:00100000:2.0:1788970260.256904:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256919:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102194432:0@lo:400: 00000100:00100000:2.0:1788970260.256939:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.256968:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102194944:0@lo:400: 00000100:00100000:2.0:1788970260.257004:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.257026:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102195328:0@lo:13: 00000100:00100000:2.0:1788970260.257058:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.257099:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193536 00000100:00100000:2.0:1788970260.257103:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193536 00000100:00100000:1.0:1788970260.257184:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194432 00000100:00100000:1.0:1788970260.257188:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194432 00000100:00100000:1.0:1788970260.257237:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194944 00000100:00100000:1.0:1788970260.257241:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194944 00000100:00100000:1.0:1788970260.257257:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970260.257263:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102194432:12345-0@lo:400: 00000100:00100000:1.0:1788970260.257300:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102194432:12345-0@lo:400: Request processed in 37us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970260.257306:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970260.257318:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788970260.257324:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102194944:12345-0@lo:400: 00000100:00100000:1.0:1788970260.257365:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102194944:12345-0@lo:400: Request processed in 40us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970260.257372:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788970260.257405:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970260.257408:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970260.257427:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef2a940 x1875871102194432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.257438:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102194432:0@lo:400: 00010000:00080000:1.0:1788970260.257459:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366d2c0 x1875871102194944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.257468:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102194944:0@lo:400: 00000100:00100000:2.0:1788970260.260343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788970260.260353:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102193536:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260452:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102193536:12345-0@lo:400: Request processed in 100us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260459:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788970260.260502:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194048 00000100:00100000:2.0:1788970260.260510:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194048 00000100:00100000:2.0:1788970260.260532:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193792 00000100:00100000:2.0:1788970260.260534:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193792 00000100:00100000:2.0:1788970260.260546:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970260.260550:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102194048:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260587:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102194048:12345-0@lo:400: Request processed in 35us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260592:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970260.260603:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970260.260609:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102193792:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260641:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102193792:12345-0@lo:400: Request processed in 33us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260647:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970260.260670:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193664 00000100:00100000:2.0:1788970260.260674:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193664 00000100:00100000:2.0:1788970260.260692:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194176 00000100:00100000:2.0:1788970260.260694:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194176 00000100:00100000:2.0:1788970260.260710:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194688 00000100:00100000:2.0:1788970260.260713:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194688 00000100:00100000:2.0:1788970260.260725:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194304 00000100:00100000:2.0:1788970260.260728:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194304 00000100:00100000:2.0:1788970260.260739:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102194816 00000100:00100000:2.0:1788970260.260742:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102194816 00000100:00100000:2.0:1788970260.260763:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102193920 00000100:00100000:2.0:1788970260.260766:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102193920 00000100:00100000:2.0:1788970260.260777:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970260.260782:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102193664:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260814:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102193664:12345-0@lo:400: Request processed in 31us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260820:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970260.260831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788970260.260837:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102194176:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260863:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102194176:12345-0@lo:400: Request processed in 27us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260868:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788970260.260879:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788970260.260885:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102194688:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260911:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102194688:12345-0@lo:400: Request processed in 27us (4904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788970260.260929:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970260.260934:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102194304:12345-0@lo:400: 00000100:00100000:2.0:1788970260.260960:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102194304:12345-0@lo:400: Request processed in 26us (4824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.260965:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970260.260975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788970260.260980:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102194816:12345-0@lo:400: 00000100:00100000:2.0:1788970260.261005:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102194816:12345-0@lo:400: Request processed in 25us (4830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.261019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788970260.261032:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970260.261037:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102193920:12345-0@lo:400: 00000100:00100000:2.0:1788970260.261067:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102193920:12345-0@lo:400: Request processed in 30us (4164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.261072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970260.261101:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102195200 00000100:00100000:2.0:1788970260.261105:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102195200 00000100:00100000:2.0:1788970260.261121:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102195328 00000100:00100000:2.0:1788970260.261123:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102195328 00000100:00100000:2.0:1788970260.261134:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970260.261140:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102195200:12345-0@lo:13: 00002000:00000024:2.0:1788970260.261163:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970260.261196:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102195200:12345-0@lo:13: Request processed in 56us (5151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.261201:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970260.261226:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788970260.261233:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102195328:12345-0@lo:13: 00002000:00000024:2.0:1788970260.261242:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970260.261267:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102195328:12345-0@lo:13: Request processed in 36us (4210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.261272:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788970260.263317:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970260.263326:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788970260.263374:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5824000 x1875871102195328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.263413:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102195328:0@lo:13: 00000100:00100000:1.0:1788970260.263430:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102193920:0@lo:400: 00000100:00100000:1.0:1788970260.263444:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102193792:0@lo:400: 00010000:00080000:1.0:1788970260.263458:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef2bc00 x1875871102194304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.263467:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102194304:0@lo:400: 00010000:00080000:1.0:1788970260.263480:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366da40 x1875871102194816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.263487:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102194816:0@lo:400: 00000100:00100000:1.0:1788970260.263535:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102193664:0@lo:400: 00000100:00100000:1.0:1788970260.263548:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102194176:0@lo:400: 00000100:00100000:1.0:1788970260.263558:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102194688:0@lo:400: 00010000:00080000:1.0:1788970260.263569:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366c000 x1875871102195200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970260.263581:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102195200:0@lo:13: 00000100:00100000:1.0:1788970260.263614:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102193536:0@lo:400: 00000100:00100000:1.0:1788970260.263626:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102194048:0@lo:400: 00010000:00010000:0.0:1788970260.515552:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788970260.771652:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00010000:00010000:0.0:1788970261.534653:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970261.789413:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970261.789515:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102195456:0@lo:13: 00000100:00100000:1.0:1788970261.789610:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970261.790096:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102195456 00000100:00100000:2.0:1788970261.790107:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102195456 00000100:00100000:2.0:1788970261.790670:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970261.790684:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102195456:12345-0@lo:13: 00002000:00000024:2.0:1788970261.790737:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970261.790769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102195584:0@lo:13: 00000100:00100000:2.0:1788970261.790828:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102195456:12345-0@lo:13: Request processed in 147us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970261.790835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970261.790841:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970261.790868:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102195584 00000100:00100000:2.0:1788970261.790872:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102195584 00000100:00100000:2.0:1788970261.791568:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970261.791584:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102195584:12345-0@lo:13: 00002000:00000024:2.0:1788970261.791602:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970261.791660:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102195584:12345-0@lo:13: Request processed in 81us (829us total) trans 0 rc 0/0 00010000:00080000:3.0:1788970261.792636:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5825680 x1875871102195584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970261.792663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102195584:0@lo:13: 00000100:00100000:2.0:1788970261.797016:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788970261.797116:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83678f00 x1875871102195456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970261.797273:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102195456:0@lo:13: 00010000:00010000:2.0:1788970262.557454:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970262.818742:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102195712:0@lo:41: 00000100:00100000:2.0:1788970262.818841:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970262.819036:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102195712 00000100:00100000:1.0:1788970262.819047:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102195712 00000100:00100000:1.0:1788970262.819122:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788970262.819134:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102195712:12345-0@lo:41: 00000004:00000024:1.0:1788970262.819181:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788970262.819254:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102195712:12345-0@lo:41: Request processed in 122us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970262.819263:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788970262.819322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102195712:0@lo:41: 00000020:00000080:2.0:1788970262.916796:0:10338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdba32dc40 20000000:00000080:2.0:1788970262.916822:0:10338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7d83658800 uarg=0000000000000000 20000000:01000000:2.0:1788970262.917052:0:10338:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788970262.917056:0:10338:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788970262.917059:0:10338:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788970262.917066:0:10338:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788970262.917072:0:10338:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788970262.917231:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788970262.917235:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788970262.917814:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788970262.918331:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788970262.918370:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788970262.918554:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788970262.918569:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788970262.918572:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788970262.919172:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788970262.919523:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788970262.919550:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788970262.919567:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788970262.919578:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788970262.919581:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788970262.920002:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788970262.920266:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788970262.920287:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788970262.920317:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788970262.920327:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788970262.920329:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788970262.920767:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788970262.921275:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788970262.921307:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788970262.921325:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788970262.921337:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788970262.921340:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788970262.921796:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788970262.922172:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788970262.922214:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788970262.922230:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1788970262.922247:0:10338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788970262.922275:0:10338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922298:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922307:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922330:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922338:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922345:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922351:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922358:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922364:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922370:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922542:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922552:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922561:0:10338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922624:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922644:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 9 pid: 6517 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.922663:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102195840:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970262.922859:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922869:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 9 pid: 6518 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.922877:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102195968:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970262.922910:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.922918:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 23 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.922927:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196096:0@lo:104: 00000100:00100000:2.0:1788970262.922978:0:10338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970262.923028:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923037:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 23 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923056:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196224:0@lo:104: 00000100:00100000:2.0:1788970262.923078:0:10338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970262.923126:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923134:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 23 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923142:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196352:0@lo:104: 00000100:00100000:2.0:1788970262.923162:0:10338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970262.923179:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923186:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 23 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923206:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196480:0@lo:104: 00000100:00100000:2.0:1788970262.923233:0:10338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970262.923250:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923257:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 23 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923265:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196608:0@lo:104: 00010000:00010000:2.0:1788970262.923288:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923307:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 23 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923315:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196736:0@lo:104: 00010000:00010000:2.0:1788970262.923343:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923350:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 23 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923357:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196864:0@lo:104: 00010000:00010000:2.0:1788970262.923432:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923439:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 23 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923447:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196992:0@lo:104: 00010000:00010000:2.0:1788970262.923469:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.923477:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 23 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.923484:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102197120:0@lo:104: 00000100:00100000:2.0:1788970262.923502:0:10338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970262.923739:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788970262.923762:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.923776:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.923799:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.923809:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.923818:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.923828:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196096 00000100:00100000:3.0:1788970262.923836:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196096 00000100:00100000:3.0:1788970262.923896:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196224 00000100:00100000:3.0:1788970262.923900:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196224 00000100:00100000:3.0:1788970262.923910:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196352 00000100:00100000:3.0:1788970262.923912:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196352 00000100:00100000:3.0:1788970262.923919:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196480 00000100:00100000:3.0:1788970262.923921:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196480 00000100:00100000:3.0:1788970262.923928:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196608 00000100:00100000:3.0:1788970262.923931:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196608 00000100:00100000:3.0:1788970262.923939:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196736 00000100:00100000:3.0:1788970262.923941:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196736 00000100:00100000:3.0:1788970262.923950:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196864 00000100:00100000:3.0:1788970262.923952:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196864 00000100:00100000:3.0:1788970262.923961:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102196992 00000100:00100000:3.0:1788970262.923963:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102196992 00000100:00100000:3.0:1788970262.923973:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197120 00000100:00100000:3.0:1788970262.923975:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197120 00000100:00100000:3.0:1788970262.923988:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970262.923997:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:10338:x1875871102196096:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924013:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924098:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970262.924105:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+11:10338:x1875871102196096:12345-0@lo:104: Request processed in 109us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924113:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970262.924135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970262.924141:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:10338:x1875871102196224:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924155:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924206:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788970262.924214:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+10:10338:x1875871102196224:12345-0@lo:104: Request processed in 71us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970262.924234:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970262.924241:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:10338:x1875871102196352:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924249:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924280:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788970262.924285:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+9:10338:x1875871102196352:12345-0@lo:104: Request processed in 45us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924290:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970262.924302:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970262.924307:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaefff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+8:10338:x1875871102196480:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924315:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924341:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788970262.924346:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaefff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+8:10338:x1875871102196480:12345-0@lo:104: Request processed in 38us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924351:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970262.924428:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970262.924436:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+7:10338:x1875871102196608:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924450:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924479:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788970262.924484:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+7:10338:x1875871102196608:12345-0@lo:104: Request processed in 50us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924490:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970262.924502:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970262.924507:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:10338:x1875871102196736:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924513:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924535:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788970262.924541:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:10338:x1875871102196736:12345-0@lo:104: Request processed in 34us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924547:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970262.924559:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970262.924564:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:10338:x1875871102196864:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924572:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924596:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788970262.924601:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:10338:x1875871102196864:12345-0@lo:104: Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924607:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970262.924618:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788970262.924623:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:10338:x1875871102196992:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924636:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924667:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1788970262.924672:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:10338:x1875871102196992:12345-0@lo:104: Request processed in 49us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924678:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788970262.924692:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970262.924698:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:10338:x1875871102197120:12345-0@lo:104: 00010000:00010000:3.0:1788970262.924705:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924731:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1788970262.924736:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:10338:x1875871102197120:12345-0@lo:104: Request processed in 39us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.924741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788970262.924766:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788970262.924773:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924780:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.924785:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924795:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.924804:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.924818:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.924855:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924862:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.924886:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924894:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c6e815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e81c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924912:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788970262.924915:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924921:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9be00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.924924:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924931:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.924938:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.924944:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.924958:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924964:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.924977:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924984:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9be00/0xc3abfebe76c6e7f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7f9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.924994:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788970262.924997:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925003:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925006:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925013:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925018:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925025:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925038:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925044:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925065:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925072:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98200/0xc3abfebe76c6e7cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925081:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788970262.925090:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925096:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925099:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925105:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925111:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925116:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925130:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925135:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925140:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925146:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5c00/0xc3abfebe76c6e7ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e7b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925154:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788970262.925157:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925162:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925164:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925180:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925185:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925203:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925218:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925224:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925229:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925236:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6e790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e797 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925246:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788970262.925249:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925254:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7e80030a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925256:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925262:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925268:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925279:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925292:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925298:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925303:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925309:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e80030a00/0xc3abfebe76c6e782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e789 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925321:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788970262.925324:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925330:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925333:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925339:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925345:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925351:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925362:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925368:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925416:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925424:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c6e774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e77b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925434:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970262.925437:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925443:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925446:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925453:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925459:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925464:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925478:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925484:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925489:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925495:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5e00/0xc3abfebe76c6e735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e73c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925504:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970262.925513:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925519:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970262.925521:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925527:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970262.925532:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970262.925537:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970262.925550:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925556:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970262.925561:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925567:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b000/0xc3abfebe76c6e70b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e712 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.925584:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970262.925586:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970262.925588:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970262.925609:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197248:0@lo:103: 00000100:00100000:3.0:1788970262.925669:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925715:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197760:0@lo:103: 00000100:00100000:3.0:1788970262.925750:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925771:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102198272:0@lo:103: 00000100:00100000:3.0:1788970262.925791:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925816:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788970262.925822:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197376:0@lo:103: 00000100:00100000:3.0:1788970262.925841:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925857:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197888:0@lo:103: 00000100:00100000:3.0:1788970262.925874:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102197504:0@lo:103: 00000100:00100000:3.0:1788970262.925917:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925926:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102198016:0@lo:103: 00000100:00100000:3.0:1788970262.925958:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.925972:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970262.925977:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102197632:0@lo:103: 00000100:00100000:3.0:1788970262.925997:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.926006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102198144:0@lo:103: 00000100:00100000:3.0:1788970262.926023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970262.926052:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197248 00000100:00100000:3.0:1788970262.926060:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197248 00010000:00010000:3.0:1788970262.926089:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 24 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926109:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197760 00000100:00100000:3.0:1788970262.926112:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197760 00010000:00010000:3.0:1788970262.926120:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 25 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926143:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198272 00000100:00100000:3.0:1788970262.926147:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198272 00010000:00010000:3.0:1788970262.926159:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 26 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926168:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197376 00000100:00100000:3.0:1788970262.926170:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197376 00010000:00010000:3.0:1788970262.926178:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 27 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926187:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197888 00000100:00100000:3.0:1788970262.926189:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197888 00010000:00010000:3.0:1788970262.926214:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 28 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926224:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197504 00000100:00100000:3.0:1788970262.926226:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197504 00010000:00010000:3.0:1788970262.926236:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 29 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926244:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198016 00000100:00100000:3.0:1788970262.926246:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198016 00010000:00010000:3.0:1788970262.926254:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 30 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926263:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102197632 00000100:00100000:3.0:1788970262.926265:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102197632 00010000:00010000:3.0:1788970262.926286:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 31 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926297:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198144 00000100:00100000:3.0:1788970262.926304:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198144 00010000:00010000:3.0:1788970262.926316:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 32 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.926332:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970262.926339:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0c18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+32:3651:x1875871102197248:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926354:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926359:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 32 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926370:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 32 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926417:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926459:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0c18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+32:3651:x1875871102197248:12345-0@lo:103: Request processed in 119us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926467:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970262.926515:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970262.926522:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+31:3651:x1875871102197760:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926529:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926533:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 31 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926541:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 31 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926550:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926572:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+31:3651:x1875871102197760:12345-0@lo:103: Request processed in 51us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926578:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970262.926600:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970262.926605:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+30:3651:x1875871102198272:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926613:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926618:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 30 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926626:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 30 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926636:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926658:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee43c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+30:3651:x1875871102198272:12345-0@lo:103: Request processed in 54us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926664:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970262.926675:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970262.926681:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+29:3651:x1875871102197376:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926688:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926692:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 29 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926699:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 29 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926708:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926727:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee41680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+29:3651:x1875871102197376:12345-0@lo:103: Request processed in 47us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926733:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970262.926744:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970262.926749:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+28:3651:x1875871102197888:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926756:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926767:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 28 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926775:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 28 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926786:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926809:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+28:3651:x1875871102197888:12345-0@lo:103: Request processed in 60us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926816:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970262.926828:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970262.926834:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+27:3649:x1875871102197504:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926842:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926846:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 27 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926854:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 27 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926863:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926889:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+27:3649:x1875871102197504:12345-0@lo:103: Request processed in 56us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926895:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970262.926908:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970262.926914:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3649:x1875871102198016:12345-0@lo:103: 00010000:00010000:3.0:1788970262.926922:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.926925:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 26 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926945:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 26 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.926954:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.926977:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3649:x1875871102198016:12345-0@lo:103: Request processed in 63us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.926982:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970262.926994:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788970262.926999:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+25:3649:x1875871102197632:12345-0@lo:103: 00010000:00010000:3.0:1788970262.927007:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.927011:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 25 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.927020:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 25 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.927029:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.927051:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+25:3649:x1875871102197632:12345-0@lo:103: Request processed in 51us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.927056:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788970262.927087:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970262.927093:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102198144:12345-0@lo:103: 00010000:00010000:3.0:1788970262.927100:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.927104:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 24 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.927112:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 24 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.927127:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.927150:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102198144:12345-0@lo:103: Request processed in 57us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.927156:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788970262.927316:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e81c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e815 expref: 23 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927347:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196096:0@lo:104: 00010000:00010000:2.0:1788970262.927364:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e7f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e7f2 expref: 22 pid: 6517 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927373:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196224:0@lo:104: 00010000:00010000:2.0:1788970262.927402:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4200/0xc3abfebe76c6e7dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e7cf expref: 21 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927413:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196352:0@lo:104: 00010000:00010000:2.0:1788970262.927423:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80031800/0xc3abfebe76c6e7b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e7ac expref: 20 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927432:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196480:0@lo:104: 00010000:00010000:2.0:1788970262.927442:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c6e797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e790 expref: 19 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927449:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196608:0@lo:104: 00010000:00010000:2.0:1788970262.927459:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e782 expref: 18 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927466:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196736:0@lo:104: 00010000:00010000:2.0:1788970262.927474:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6e77b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e774 expref: 17 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927480:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196864:0@lo:104: 00010000:00010000:2.0:1788970262.927489:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80031a00/0xc3abfebe76c6e73c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e735 expref: 16 pid: 6518 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927505:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102196992:0@lo:104: 00010000:00010000:2.0:1788970262.927519:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e70b expref: 15 pid: 6516 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.927527:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102197120:0@lo:104: 00010000:00010000:0.0:1788970262.927811:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970262.930544:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197376:0@lo:103: 00000100:00100000:2.0:1788970262.930563:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197888:0@lo:103: 00000100:00100000:2.0:1788970262.930574:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197248:0@lo:103: 00000100:00100000:2.0:1788970262.930584:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102197760:0@lo:103: 00000100:00100000:2.0:1788970262.930594:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102198272:0@lo:103: 00000100:00100000:2.0:1788970262.933527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102197632:0@lo:103: 00000100:00100000:2.0:1788970262.933560:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102198144:0@lo:103: 00000100:00100000:2.0:1788970262.933584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102197504:0@lo:103: 00000100:00100000:2.0:1788970262.933608:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102198016:0@lo:103: 00000100:00100000:0.0:1788970262.939760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970262.939836:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222336 00000100:00100000:3.0:1788970262.939863:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222336 00010000:00010000:3.0:1788970262.939920:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 10 pid: 6518 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970262.939974:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:3.0:1788970262.939984:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082222336:12345-192.168.203.15@tcp:103: 00010000:00010000:3.0:1788970262.940013:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.940021:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 10 pid: 6518 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.940033:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 10 pid: 6518 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.940056:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970262.940206:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102195840:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970262.949585:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082222336:12345-192.168.203.15@tcp:103: Request processed in 9582us (9814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.949605:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1788970262.949837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970262.950147:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222208 00000100:00100000:3.0:1788970262.950162:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222208 00010000:00010000:3.0:1788970262.950216:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 10 pid: 6517 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.950232:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d608 expref: 10 pid: 6518 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970262.950247:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1875871102195968:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970262.950249:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1788970262.950275:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:2403:x1875871082222208:12345-192.168.203.15@tcp:103: 00010000:00010000:3.0:1788970262.950292:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970262.950300:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 9 pid: 6517 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.950462:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 9 pid: 6517 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951514:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d60f expref: 9 pid: 6517 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951539:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951550:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951577:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951585:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951592:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951600:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951607:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970262.951611:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951634:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951645:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.951658:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970262.951732:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:2403:x1875871082222208:12345-192.168.203.15@tcp:103: Request processed in 1457us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.951743:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00010000:00010000:2.0:1788970262.952421:0:10338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.952533:0:10338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.952541:0:10338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970262.952548:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99800/0xc3abfebe76c6e877 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970263.496935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970263.497096:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222464 00000100:00100000:1.0:1788970263.497106:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222464 00000100:00100000:1.0:1788970263.497174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:1.0:1788970263.497185:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:6174:x1875871082222464:12345-192.168.203.15@tcp:101: 00010000:00010000:1.0:1788970263.497213:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970263.497234:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654200/0xc3abfebe76c6e87e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d67f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970263.497279:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654200/0xc3abfebe76c6e87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d67f expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970263.497298:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654200/0xc3abfebe76c6e87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d67f expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970263.497310:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654200, rc 0) 00000100:00100000:1.0:1788970263.497370:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082222464:12345-192.168.203.15@tcp:101: Request processed in 187us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970263.497378:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:0.0:1788970263.505891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970263.506136:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222592 00000100:00100000:1.0:1788970263.506154:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222592 00000100:00100000:1.0:1788970263.506552:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:1.0:1788970263.506564:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082222592:12345-192.168.203.15@tcp:501: 00000100:00100000:1.0:1788970263.506760:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082222592:12345-192.168.203.15@tcp:501: Request processed in 198us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970263.506768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:3.0:1788970263.515883:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970263.516122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222720 00000100:00100000:2.0:1788970263.516133:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222720 00000100:00100000:1.0:1788970263.516366:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:1.0:1788970263.516403:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082222720:12345-192.168.203.15@tcp:503: 00000100:00100000:1.0:1788970263.516606:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082222720:12345-192.168.203.15@tcp:503: Request processed in 230us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970263.516614:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:0.0:1788970263.524866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970263.525509:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222848 00000100:00100000:3.0:1788970263.525524:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222848 00000100:00100000:3.0:1788970263.525637:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:3.0:1788970263.525650:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6649:x1875871082222848:12345-192.168.203.15@tcp:502: 00000100:00100000:3.0:1788970263.525870:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6649:x1875871082222848:12345-192.168.203.15@tcp:502: Request processed in 222us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970263.525878:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:0.0:1788970263.528885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970263.529062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082222976 00000100:00100000:2.0:1788970263.529075:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082222976 00000100:00100000:2.0:1788970263.529318:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:2.0:1788970263.529330:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6649:x1875871082222976:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970263.530032:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6649:x1875871082222976:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 700us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970263.530043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:0.0:1788970263.535757:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970263.536652:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223104 00000100:00100000:3.0:1788970263.536668:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223104 00000100:00100000:3.0:1788970263.536739:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 204 00000100:00100000:3.0:1788970263.536751:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082223104:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970263.536773:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970263.536794:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970263.536831:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d686 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970263.536863:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d686 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970263.536874:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b000, rc 0) 00000100:00100000:3.0:1788970263.537003:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223104:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 254us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970263.537010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 204 00000100:00100000:0.0:1788970263.550670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970263.555338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223232 00000100:00100000:2.0:1788970263.555364:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223232 00000100:00100000:2.0:1788970263.555510:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 205 00000100:00100000:2.0:1788970263.555524:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223232:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970263.555714:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223232:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 192us (5059us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970263.555724:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 205 00010000:00010000:3.0:1788970263.582856:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970264.350349:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970264.350408:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102198400:0@lo:41: 00000100:00100000:0.0:1788970264.350512:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.350601:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198400 00000100:00100000:0.0:1788970264.350611:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198400 00000100:00100000:0.0:1788970264.350673:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970264.350684:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102198400:12345-0@lo:41: 00000004:00000024:0.0:1788970264.350743:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970264.350799:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102198400:12345-0@lo:41: Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.350806:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970264.350863:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102198400:0@lo:41: 00010000:00010000:1.0:1788970264.614112:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970264.617424:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788970264.617436:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7d81ace000 from 48 10000000:01000000:0.0:1788970264.617636:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970264.617700:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.617712:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.617724:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970264.617763:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102198528:0@lo:101: 00000100:00100000:0.0:1788970264.617851:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.617929:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.617935:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198528 00000100:00100000:1.0:1788970264.617955:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198528 00000100:00100000:1.0:1788970264.618034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788970264.618045:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+15:6521:x1875871102198528:12345-0@lo:101: 00010000:00010000:1.0:1788970264.618062:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970264.618086:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6e893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e88c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.618116:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6e893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e88c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.618127:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6e893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e88c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.618136:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655200, rc 0) 00000100:00100000:1.0:1788970264.618199:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102198528:12345-0@lo:101: Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.618207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788970264.618230:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102198528:0@lo:101: 00010000:00010000:0.0:1788970264.618245:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.618256:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970264.618328:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102198656:0@lo:501: 00000100:00100000:0.0:1788970264.618355:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.618377:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.618550:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198656 00000100:00100000:1.0:1788970264.618555:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198656 00000100:00100000:1.0:1788970264.618589:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788970264.618597:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102198656:12345-0@lo:501: 00000100:00100000:1.0:1788970264.621121:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102198656:12345-0@lo:501: Request processed in 2514us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.621139:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788970264.621188:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102198656:0@lo:501: 00000100:00100000:0.0:1788970264.621294:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102198784:0@lo:503: 00000100:00100000:0.0:1788970264.621365:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.621445:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.621574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198784 00000100:00100000:1.0:1788970264.621583:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198784 00000100:00100000:1.0:1788970264.621637:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788970264.621647:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102198784:12345-0@lo:503: 00000100:00100000:1.0:1788970264.621782:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102198784:12345-0@lo:503: Request processed in 136us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.621797:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788970264.621827:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102198784:0@lo:503: 00000100:00100000:0.0:1788970264.623954:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10364:1875871102198912:0@lo:502: 00000100:00100000:0.0:1788970264.624057:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.624110:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.624896:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102198912 00000100:00100000:1.0:1788970264.624907:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102198912 00000100:00100000:1.0:1788970264.625041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788970264.625053:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:10364:x1875871102198912:12345-0@lo:502: 00000100:00100000:0.0:1788970264.626453:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10364:1875871102198912:0@lo:502: 00000100:00100000:1.0:1788970264.626523:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:10364:x1875871102198912:12345-0@lo:502: Request processed in 887us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.626536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788970264.626555:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10364:1875871102199040:0@lo:502: 00000100:00100000:0.0:1788970264.626608:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.626654:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.627090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199040 00000100:00100000:1.0:1788970264.627098:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199040 00000100:00100000:1.0:1788970264.627143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788970264.627152:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:10364:x1875871102199040:12345-0@lo:502: 00000100:00100000:1.0:1788970264.627291:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:10364:x1875871102199040:12345-0@lo:502: Request processed in 140us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.627298:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788970264.627639:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10364:1875871102199040:0@lo:502: 00000040:00080000:3.0:1788970264.627675:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788970264.628558:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788970264.628594:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970264.628608:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.628622:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970264.628634:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788970264.628637:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788970264.628641:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788970264.628682:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.628698:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.628711:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970264.628734:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199168:0@lo:101: 00000100:00100000:1.0:1788970264.628797:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.628844:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.629215:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199168 00000100:00100000:3.0:1788970264.629224:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199168 00000100:00100000:3.0:1788970264.629277:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788970264.629286:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+16:6521:x1875871102199168:12345-0@lo:101: 00010000:00010000:3.0:1788970264.629300:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970264.629315:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c6e8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e89a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.629353:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c6e8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e89a expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.629365:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c6e8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e89a expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.629374:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9be00, rc 0) 00000100:00100000:3.0:1788970264.629612:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102199168:12345-0@lo:101: Request processed in 326us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.629630:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788970264.630375:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199168:0@lo:101: 00010000:00010000:1.0:1788970264.630599:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.630613:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970264.630720:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199296:0@lo:501: 00000100:00100000:1.0:1788970264.630778:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.630872:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.634558:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199296 00000100:00100000:0.0:1788970264.634582:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199296 00000100:00100000:0.0:1788970264.634658:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788970264.634687:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102199296:12345-0@lo:501: 00000100:00100000:0.0:1788970264.638634:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102199296:12345-0@lo:501: Request processed in 3940us (7844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.638654:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788970264.640121:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199296:0@lo:501: 00000100:00100000:1.0:1788970264.640210:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199424:0@lo:503: 00000100:00100000:1.0:1788970264.640648:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.640696:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.640888:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199424 00000100:00100000:0.0:1788970264.640898:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199424 00000100:00100000:0.0:1788970264.640965:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788970264.640976:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102199424:12345-0@lo:503: 00000100:00100000:0.0:1788970264.641143:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102199424:12345-0@lo:503: Request processed in 167us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.641151:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788970264.642020:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199424:0@lo:503: 00000100:00100000:1.0:1788970264.644498:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10366:1875871102199552:0@lo:502: 00000100:00100000:1.0:1788970264.644622:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.644673:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.645058:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199552 00000100:00100000:3.0:1788970264.645069:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199552 00000100:00100000:3.0:1788970264.645138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788970264.645149:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:10366:x1875871102199552:12345-0@lo:502: 00000100:00100000:3.0:1788970264.645344:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:10366:x1875871102199552:12345-0@lo:502: Request processed in 195us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.645353:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788970264.647019:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10366:1875871102199552:0@lo:502: 00000020:01000000:1.0:1788970264.647088:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970264.647101:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970264.647104:0:10366:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788970264.647110:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788970264.647157:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10366:1875871102199680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970264.647254:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.647658:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.647759:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199680 00000100:00100000:3.0:1788970264.647769:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199680 00000100:00100000:3.0:1788970264.648773:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788970264.648789:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:10366:x1875871102199680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.649266:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:10366:x1875871102199680:12345-0@lo:502:llog_process_th.0 Request processed in 480us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.649275:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788970264.649886:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10366:1875871102199680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970264.649937:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970264.649948:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970264.649950:0:10366:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788970264.649956:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788970264.650233:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788970264.650260:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788970264.650272:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.650285:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970264.650295:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788970264.650299:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eaed7c000 from 48 10000000:01000000:3.0:1788970264.650303:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970264.650906:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.650928:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.651020:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.651051:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.651271:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.651325:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199808 00000100:00100000:3.0:1788970264.651332:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199808 00000100:00100000:3.0:1788970264.651694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788970264.651705:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+17:6521:x1875871102199808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.651722:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970264.651741:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e8af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8a8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.651772:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8a8 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.651784:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8a8 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.651795:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b800, rc 0) 00000100:00100000:3.0:1788970264.651836:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102199808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.651843:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788970264.652207:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d825e9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.652243:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.652260:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.652271:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.652365:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.652432:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.652454:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d825e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970264.652519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102199936 00000100:00100000:2.0:1788970264.652532:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102199936 00000100:00100000:2.0:1788970264.652573:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788970264.652582:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102199936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970264.652742:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102199936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970264.652749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788970264.652855:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102199936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.652892:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.652941:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.654704:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.655537:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200064 00000100:00100000:3.0:1788970264.655553:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200064 00000100:00100000:3.0:1788970264.655659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788970264.655671:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102200064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.655893:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102200064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.655902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788970264.656242:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.657106:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10368:1875871102200192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.657176:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970264.658282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200192 00000100:00100000:2.0:1788970264.658295:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200192 00000100:00100000:3.0:1788970264.658611:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788970264.658623:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:10368:x1875871102200192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.658819:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:10368:x1875871102200192:12345-0@lo:502:llog_process_th.0 Request processed in 197us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.658829:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788970264.658998:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.659025:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10368:1875871102200192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.659099:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10368:1875871102200320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.659145:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.659170:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.659247:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200320 00000100:00100000:3.0:1788970264.659252:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200320 00000100:00100000:3.0:1788970264.659324:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788970264.659333:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:10368:x1875871102200320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.659451:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:10368:x1875871102200320:12345-0@lo:502:llog_process_th.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.659459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788970264.662545:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10368:1875871102200320:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788970264.662616:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788970264.663318:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788970264.663357:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970264.663372:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.663428:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970264.663441:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788970264.663453:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788970264.663457:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788970264.663605:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.663615:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.663628:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.663654:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.663736:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.663858:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d825e9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.664004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200448 00000100:00100000:0.0:1788970264.664016:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200448 00000100:00100000:0.0:1788970264.664080:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788970264.664092:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+18:6521:x1875871102200448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970264.664109:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970264.664126:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae013c00/0xc3abfebe76c6e8bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.664153:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae013c00/0xc3abfebe76c6e8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8b6 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.664166:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae013c00/0xc3abfebe76c6e8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8b6 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.664175:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013c00, rc 0) 00000100:00100000:0.0:1788970264.664241:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102200448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.664248:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788970264.664330:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970264.664347:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.664357:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970264.664637:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.664669:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.664698:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200576 00000100:00100000:1.0:1788970264.664702:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200576 00000100:00100000:1.0:1788970264.664729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788970264.664746:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102200576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.666964:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102200576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2209us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.666981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788970264.676764:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.676839:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.676923:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.677031:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.677068:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.677238:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200704 00000100:00100000:3.0:1788970264.677248:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200704 00000100:00100000:3.0:1788970264.677315:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788970264.677335:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102200704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.678366:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102200704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1029us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.678377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788970264.683261:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102200704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.684371:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10370:1875871102200832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970264.684699:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.684748:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.684817:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200832 00000100:00100000:3.0:1788970264.684827:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200832 00000100:00100000:3.0:1788970264.684887:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788970264.684899:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:10370:x1875871102200832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.685058:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:10370:x1875871102200832:12345-0@lo:502:llog_process_th.0 Request processed in 161us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.685066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788970264.685193:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10370:1875871102200832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970264.685229:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970264.685241:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970264.685244:0:10370:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788970264.685251:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788970264.685277:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10370:1875871102200960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970264.685313:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.685342:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.685413:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102200960 00000100:00100000:0.0:1788970264.685418:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102200960 00000100:00100000:0.0:1788970264.685451:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788970264.685459:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:10370:x1875871102200960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.685569:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:10370:x1875871102200960:12345-0@lo:502:llog_process_th.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.685577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788970264.685792:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10370:1875871102200960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970264.685813:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970264.685817:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970264.685819:0:10370:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788970264.685823:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788970264.686081:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788970264.686105:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788970264.686116:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.686129:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970264.686139:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788970264.686142:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7ebb899800 from 48 10000000:01000000:0.0:1788970264.686145:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970264.686189:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.686199:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.686209:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970264.686226:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836ded00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.686260:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.686293:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.686332:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201088 00000100:00100000:3.0:1788970264.686337:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201088 00000100:00100000:3.0:1788970264.686374:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788970264.686411:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:6521:x1875871102201088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.686422:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970264.686438:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c6e8cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.686465:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c6e8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8c4 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.686674:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c6e8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8c4 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.686686:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b600, rc 0) 00000100:00100000:3.0:1788970264.686739:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102201088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 358us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.686752:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788970264.686829:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836ded00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970264.686843:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.686852:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970264.686922:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.686951:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.686983:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.687027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201216 00000100:00100000:3.0:1788970264.687031:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201216 00000100:00100000:3.0:1788970264.687064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788970264.687072:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102201216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.687216:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102201216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.687223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788970264.687286:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.687311:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.687352:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.687372:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.687740:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201344 00000100:00100000:0.0:1788970264.687746:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201344 00000100:00100000:0.0:1788970264.687776:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788970264.687791:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102201344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.687890:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102201344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.687898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788970264.688659:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.688910:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10371:1875871102201472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.688969:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.688997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201472 00000100:00100000:0.0:1788970264.689003:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201472 00000100:00100000:0.0:1788970264.689031:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788970264.689038:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:10371:x1875871102201472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.689145:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:10371:x1875871102201472:12345-0@lo:502:llog_process_th.0 Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.689152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788970264.689214:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e83e51600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.689228:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10371:1875871102201472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.689270:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10371:1875871102201600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.689305:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.689320:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970264.691537:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201600 00000100:00100000:2.0:1788970264.691558:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201600 00000100:00100000:2.0:1788970264.691642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788970264.691653:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:10371:x1875871102201600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970264.691932:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:10371:x1875871102201600:12345-0@lo:502:llog_process_th.0 Request processed in 280us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970264.691940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788970264.693763:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10371:1875871102201600:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788970264.693833:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788970264.694100:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788970264.694132:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788970264.694145:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.694158:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970264.694194:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788970264.694198:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788970264.694201:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788970264.694248:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.694257:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.694267:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970264.694292:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.694370:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.694451:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.694667:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201728 00000100:00100000:3.0:1788970264.694675:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201728 00000100:00100000:3.0:1788970264.694719:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788970264.694728:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102201728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.694743:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970264.694759:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c6e8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8d2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.694788:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c6e8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8d2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.694800:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c6e8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8d2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.694810:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9aa00, rc 0) 00000100:00100000:3.0:1788970264.694859:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102201728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.694876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788970264.694927:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.694942:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.694952:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.695018:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.695048:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.695071:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.695085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201856 00000100:00100000:3.0:1788970264.695089:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201856 00000100:00100000:3.0:1788970264.695110:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788970264.695116:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102201856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.695263:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102201856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.695271:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788970264.695301:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.695329:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.695371:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.695422:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.695432:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102201984 00000100:00100000:3.0:1788970264.695435:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102201984 00000100:00100000:3.0:1788970264.695455:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788970264.695478:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102201984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.695563:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102201984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.695569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788970264.695607:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102201984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.699861:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10372:1875871102202112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.700002:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.700063:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.700366:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202112 00000100:00100000:3.0:1788970264.700376:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202112 00000100:00100000:3.0:1788970264.700465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788970264.700484:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10372:x1875871102202112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.700643:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10372:x1875871102202112:12345-0@lo:502:llog_process_th.0 Request processed in 161us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.700652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788970264.700884:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10372:1875871102202112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788970264.700924:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970264.700936:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970264.700939:0:10372:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970264.700947:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788970264.700975:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10372:1875871102202240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.701017:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.701051:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.701246:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202240 00000100:00100000:3.0:1788970264.701252:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202240 00000100:00100000:3.0:1788970264.701289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788970264.701296:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10372:x1875871102202240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.701367:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10372:x1875871102202240:12345-0@lo:502:llog_process_th.0 Request processed in 71us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.701375:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788970264.701580:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10372:1875871102202240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788970264.701608:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970264.701614:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970264.701616:0:10372:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788970264.701620:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788970264.701805:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788970264.701830:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788970264.701841:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.701854:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970264.701876:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788970264.701879:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eb0d2c000 from 48 10000000:01000000:3.0:1788970264.701882:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970264.701912:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.701921:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.701931:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.701947:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102202368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.701978:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.702038:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.705783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202368 00000100:00100000:0.0:1788970264.705802:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202368 00000100:00100000:3.0:1788970264.706518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788970264.706533:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102202368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.706555:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970264.706581:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8e0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.706616:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8e0 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.706629:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8e0 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.706640:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a600, rc 0) 00000100:00100000:3.0:1788970264.706751:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102202368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (4771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.706758:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788970264.706827:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102202368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.706848:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.706858:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.706948:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102202496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.706986:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.707018:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970264.707226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202496 00000100:00100000:0.0:1788970264.707233:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202496 00000100:00100000:0.0:1788970264.707272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788970264.707280:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102202496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.707453:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102202496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970264.707460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788970264.707643:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102202496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.707679:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102202624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.707725:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.707745:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.707757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202624 00000100:00100000:3.0:1788970264.707760:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202624 00000100:00100000:3.0:1788970264.707781:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788970264.707788:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102202624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.707869:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102202624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.707876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788970264.707915:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102202624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.713307:0:10373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10373:1875871102202752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.714987:0:10373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.715099:0:10373:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.720640:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202752 00000100:00100000:1.0:1788970264.720658:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202752 00000100:00100000:1.0:1788970264.720739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788970264.720752:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10373:x1875871102202752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970264.720988:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10373:x1875871102202752:12345-0@lo:502:llog_process_th.0 Request processed in 239us (6008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.720997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788970264.721227:0:10373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10373:1875871102202752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.721319:0:10373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10373:1875871102202880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.721372:0:10373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.721428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102202880 00000100:00100000:1.0:1788970264.721436:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102202880 00000100:00100000:2.0:1788970264.721859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788970264.721868:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10373:x1875871102202880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970264.721957:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10373:x1875871102202880:12345-0@lo:502:llog_process_th.0 Request processed in 90us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970264.721964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788970264.722009:0:10373:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970264.722022:0:10373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10373:1875871102202880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788970264.722043:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788970264.724575:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788970264.724626:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788970264.724640:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.724655:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970264.724666:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788970264.724669:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788970264.724672:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788970264.724717:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.724726:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970264.724754:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970264.724785:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.724872:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.724930:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef1000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970264.725091:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203008 00000100:00100000:2.0:1788970264.725101:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203008 00000100:00100000:2.0:1788970264.725573:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788970264.725587:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102203008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970264.725616:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970264.725633:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970264.725660:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8ee expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970264.725673:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8ee expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970264.725683:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99600, rc 0) 00000100:00100000:2.0:1788970264.725755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102203008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.725832:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970264.725849:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.725860:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970264.725940:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.725987:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.726014:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.726029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203136 00000100:00100000:1.0:1788970264.726033:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203136 00000100:00100000:2.0:1788970264.734580:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788970264.742861:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788970264.742883:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102203136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.743165:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102203136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (17176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.743175:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788970264.749866:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.749946:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.750034:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.751082:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.755325:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203264 00000100:00100000:3.0:1788970264.755345:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203264 00000100:00100000:3.0:1788970264.755479:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788970264.755492:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102203264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.758252:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102203264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2749us (8203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.758271:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788970264.758569:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970264.761697:0:10375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10375:1875871102203392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.761810:0:10375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.761869:0:10375:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970264.762648:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203392 00000100:00100000:3.0:1788970264.762661:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203392 00000100:00100000:3.0:1788970264.762725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788970264.762738:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10375:x1875871102203392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970264.764096:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10375:x1875871102203392:12345-0@lo:502:llog_process_th.0 Request processed in 1352us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970264.764128:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788970264.767330:0:10375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10375:1875871102203392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788970264.767423:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970264.767441:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970264.767444:0:10375:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970264.767452:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788970264.767513:0:10375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10375:1875871102203520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970264.767603:0:10375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970264.767653:0:10375:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91ef10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970264.767941:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203520 00000100:00100000:1.0:1788970264.767950:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203520 00000100:00100000:1.0:1788970264.768016:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788970264.768028:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10375:x1875871102203520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970264.768196:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10375:x1875871102203520:12345-0@lo:502:llog_process_th.0 Request processed in 170us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970264.768205:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788970264.768705:0:10375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10375:1875871102203520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970264.768755:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970264.768761:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970264.768763:0:10375:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788970264.768769:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788970264.770893:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788970264.770940:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788970264.770955:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.770970:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970264.770984:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788970264.770987:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7e848519c0 from 1 10000000:01000000:1.0:1788970264.770990:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788970264.771041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.771058:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.771074:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970264.771105:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970264.771199:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970264.771259:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970264.771887:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203648 00000100:00100000:2.0:1788970264.771900:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203648 00000100:00100000:2.0:1788970264.771967:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788970264.771978:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102203648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970264.771999:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970264.772018:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99a00/0xc3abfebe76c6e903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e8fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970264.772051:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99a00/0xc3abfebe76c6e903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8fc expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970264.772073:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99a00/0xc3abfebe76c6e903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e8fc expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970264.772085:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99a00, rc 0) 00000100:00100000:2.0:1788970264.772157:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102203648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970264.772165:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788970264.772691:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970264.772716:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970264.772729:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970264.772834:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970264.772889:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970264.772942:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970264.772966:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102203776 00000100:00100000:2.0:1788970264.772972:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102203776 00000100:00100000:2.0:1788970264.773014:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788970264.773023:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102203776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970264.773125:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102203776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (235us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970264.773132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788970264.773237:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102203776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788970264.773275:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788970264.773282:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970264.773291:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788970265.083474:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3c9a74c0 20000000:00000080:2.0:1788970265.083499:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7d82737000 uarg=0000000000000000 20000000:01000000:2.0:1788970265.083554:0:10399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788970265.083562:0:10399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788970265.083568:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788970265.084735:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788970265.086548:0:10399:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788970265.093748:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788970265.093797:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788970265.093815:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788970265.093834:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788970265.093859:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093881:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093902:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093910:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093916:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093927:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093936:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.093989:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.094008:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 9 pid: 6517 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970265.094026:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102203904:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970265.094958:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.094973:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 23 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970265.094988:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204032:0@lo:104: 00000100:00100000:2.0:1788970265.095059:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970265.095353:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.095363:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 23 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970265.095372:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204160:0@lo:104: 00000100:00100000:2.0:1788970265.095429:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970265.099801:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.099829:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 23 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970265.099849:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204288:0@lo:104: 00010000:00010000:2.0:1788970265.099919:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.099929:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 23 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970265.099937:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204416:0@lo:104: 00000100:00100000:2.0:1788970265.099960:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970265.100257:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788970265.100292:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.100309:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.100319:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204032 00000100:00100000:3.0:1788970265.100328:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204032 00000100:00100000:3.0:1788970265.100378:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204160 00000100:00100000:3.0:1788970265.100408:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204160 00000100:00100000:3.0:1788970265.100422:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204288 00000100:00100000:3.0:1788970265.100424:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204288 00000100:00100000:3.0:1788970265.100435:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204416 00000100:00100000:3.0:1788970265.100437:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204416 00000100:00100000:3.0:1788970265.100450:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970265.100460:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:10399:x1875871102204032:12345-0@lo:104: 00010000:00010000:3.0:1788970265.100477:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970265.100557:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1788970265.100565:0:6508:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1788970265.100568:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970265.100575:0:6508:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788970265.100577:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:10399:x1875871102204032:12345-0@lo:104: Request processed in 118us (5517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.100587:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970265.100610:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970265.100617:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:10399:x1875871102204160:12345-0@lo:104: 00010000:00010000:3.0:1788970265.100626:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100671:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788970265.100677:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:10399:x1875871102204160:12345-0@lo:104: Request processed in 61us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.100683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970265.100737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970265.100743:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:10399:x1875871102204288:12345-0@lo:104: 00010000:00010000:3.0:1788970265.100751:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100778:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788970265.100784:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:10399:x1875871102204288:12345-0@lo:104: Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.100790:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970265.100802:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970265.100808:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:10399:x1875871102204416:12345-0@lo:104: 00010000:00010000:3.0:1788970265.100815:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100851:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788970265.100856:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:10399:x1875871102204416:12345-0@lo:104: Request processed in 49us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.100862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788970265.100881:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788970265.100888:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100896:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970265.100901:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100910:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970265.100918:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970265.100924:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970265.100959:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100967:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970265.100988:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.100996:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98e00/0xc3abfebe76c6e727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e72e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101022:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788970265.101026:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101032:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970265.101035:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101042:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970265.101049:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970265.101054:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970265.101068:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970265.101253:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204032:0@lo:104: 00000100:00100000:2.0:1788970265.101265:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204160:0@lo:104: 00000100:00100000:2.0:1788970265.101273:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204288:0@lo:104: 00000100:00100000:2.0:1788970265.101279:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102204416:0@lo:104: 00010000:00010000:3.0:1788970265.101362:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970265.101371:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101407:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a200/0xc3abfebe76c6e601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e608 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101418:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970265.101422:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101439:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970265.101442:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101448:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970265.101455:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970265.101460:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970265.101474:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101480:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970265.101499:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101506:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec215a200/0xc3abfebe76c6e5ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101516:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970265.101519:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101525:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970265.101527:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101546:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970265.101554:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970265.101558:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970265.101573:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101579:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970265.101586:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101592:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec215ae00/0xc3abfebe76c6e59f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e5a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.101608:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970265.101610:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970265.101612:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970265.101721:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102204544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970265.101764:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.101804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970265.101810:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102204672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970265.101831:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.101861:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102204928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970265.101883:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.101899:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970265.101912:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102204800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970265.101936:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.101965:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204544 00000100:00100000:3.0:1788970265.101971:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204544 00010000:00010000:3.0:1788970265.102000:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 24 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970265.102018:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204672 00000100:00100000:3.0:1788970265.102021:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204672 00010000:00010000:3.0:1788970265.102029:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 25 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970265.102038:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204928 00000100:00100000:3.0:1788970265.102040:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204928 00010000:00010000:3.0:1788970265.102051:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 26 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970265.102061:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102204800 00000100:00100000:3.0:1788970265.102063:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102204800 00010000:00010000:0.0:1788970265.102573:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970265.102594:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970265.102608:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+27:3649:x1875871102204544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970265.102625:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970265.102639:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 27 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102650:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 27 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102666:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80030000/0xc3abfebe76c6e72e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e727 expref: 27 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102684:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970265.102748:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3649:x1875871102204544:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.102756:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970265.102776:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970265.102782:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+25:3649:x1875871102204672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970265.102790:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970265.102794:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 25 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102802:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 25 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102811:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98000/0xc3abfebe76c6e608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e601 expref: 25 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102819:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970265.102839:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102204672:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.102844:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970265.102855:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788970265.102868:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3652:x1875871102204928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970265.102876:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970265.102880:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 23 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102888:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 23 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102897:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e5a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e59f expref: 23 pid: 6518 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970265.102906:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970265.102935:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3652:x1875871102204928:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.102940:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788970265.102977:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102204928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970265.103246:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 27 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970265.103281:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970265.103289:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3652:x1875871102204800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970265.103300:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970265.103304:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 21 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.103311:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 21 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.103332:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e5b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e5ad expref: 21 pid: 6517 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.103343:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970265.103375:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:3652:x1875871102204800:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.103402:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970265.103456:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102204800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970265.103671:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102204672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970265.103681:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102204544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970265.104111:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875871102203904:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970265.104147:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970265.104272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970265.104311:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223360 00000100:00100000:1.0:1788970265.104319:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223360 00010000:00010000:1.0:1788970265.104348:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 10 pid: 6517 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970265.104410:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:1.0:1788970265.104418:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5825e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082223360:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970265.104431:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970265.104447:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 10 pid: 6517 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104457:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 10 pid: 6517 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104471:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654a00/0xc3abfebe76c6e846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d647 expref: 10 pid: 6517 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104486:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104495:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104523:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104532:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104539:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104547:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104554:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970265.104558:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104567:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104586:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970265.104596:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970265.104649:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5825e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:2403:x1875871082223360:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 232us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970265.104658:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00010000:00010000:2.0:1788970265.104922:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.104931:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970265.104937:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98800/0xc3abfebe76c6e90a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970265.135501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970265.135589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223488 00000100:00100000:3.0:1788970265.135603:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223488 00000100:00100000:3.0:1788970265.135677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:3.0:1788970265.135688:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:6174:x1875871082223488:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970265.135711:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970265.135736:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d68d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.135771:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.135785:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970265.135795:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a200, rc 0) 00000100:00100000:3.0:1788970265.135859:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223488:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 173us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.135866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:1.0:1788970265.137983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970265.138057:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223616 00000100:00100000:3.0:1788970265.138068:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223616 00000100:00100000:3.0:1788970265.138134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:3.0:1788970265.138149:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223616:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970265.138347:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223616:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 203us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.138356:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:1.0:1788970265.140520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970265.140602:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223744 00000100:00100000:3.0:1788970265.140616:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223744 00000100:00100000:3.0:1788970265.140679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:3.0:1788970265.140689:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223744:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970265.140862:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6174:x1875871082223744:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 173us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.140871:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:1.0:1788970265.143439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970265.143540:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082223872 00000100:00100000:3.0:1788970265.143553:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082223872 00000100:00100000:3.0:1788970265.143619:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:3.0:1788970265.143630:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6669:x1875871082223872:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970265.143804:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6669:x1875871082223872:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 176us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.143813:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:1.0:1788970265.149538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970265.150031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224000 00000100:00100000:2.0:1788970265.150046:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224000 00000100:00100000:2.0:1788970265.150124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:2.0:1788970265.150137:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6669:x1875871082224000:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970265.150363:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:6669:x1875871082224000:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 228us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.150371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:0.0:1788970265.286547:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970265.286593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970265.286600:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224128 00000100:00100000:1.0:1788970265.286614:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224128 00000100:00100000:0.0:1788970265.286616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970265.286635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970265.286688:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224256 00000100:00100000:1.0:1788970265.286691:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224256 00000100:00100000:0.0:1788970265.286697:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970265.286710:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082224128:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970265.286713:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1788970265.286719:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082224256:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970265.287185:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082224256:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 456us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970265.287196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1788970265.287229:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224384 00000100:00100000:1.0:1788970265.287233:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224384 00000100:00100000:1.0:1788970265.287264:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224512 00000100:00100000:1.0:1788970265.287267:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224512 00000100:00100000:1.0:1788970265.287292:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:1.0:1788970265.287299:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082224384:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970265.287342:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082224384:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 43us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970265.287350:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:1.0:1788970265.287362:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1788970265.287368:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082224512:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970265.287478:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082224512:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 50us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970265.287486:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00080000:1.0:1788970265.287503:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970265.287509:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970265.287512:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970265.287515:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970265.293287:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082224128:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 6563us (6738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.293305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970265.373928:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102205440:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.374051:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.374072:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102205056:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.374140:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102205952:0@lo:400:kworker.0 00000100:00100000:1.0:1788970265.374168:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102205312:0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.374218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102205184:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.374362:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102205568:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374402:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.374438:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102206080:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.374506:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205440 00000100:00100000:2.0:1788970265.374516:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205440 00000100:00100000:2.0:1788970265.374579:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970265.374589:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102205440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374648:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102205440:12345-0@lo:400:kworker.0 Request processed in 60us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.374656:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970265.374714:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205056 00000100:00100000:2.0:1788970265.374718:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205056 00000100:00100000:2.0:1788970265.374743:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205568 00000100:00100000:2.0:1788970265.374746:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205568 00000100:00100000:2.0:1788970265.374770:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206080 00000100:00100000:2.0:1788970265.374773:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206080 00000100:00100000:2.0:1788970265.374790:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788970265.374797:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102205056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374831:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102205056:12345-0@lo:400:kworker.0 Request processed in 34us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.374837:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788970265.374848:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970265.374854:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102205568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374877:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102205568:12345-0@lo:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.374882:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970265.374891:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788970265.374897:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.374935:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102206080:12345-0@lo:400:kworker.0 Request processed in 38us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.374941:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788970265.374967:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970265.374982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102206592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970265.375014:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.375063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102205056:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.375074:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102205568:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.375082:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102206080:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.375253:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970265.375262:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102206720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970265.375288:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.375315:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206592 00000100:00100000:2.0:1788970265.375319:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206592 00000100:00100000:2.0:1788970265.375343:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206720 00000100:00100000:2.0:1788970265.375346:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206720 00000100:00100000:2.0:1788970265.375360:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788970265.375366:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102206592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970265.375417:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970265.375457:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102206592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.375464:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788970265.375476:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788970265.375482:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102206720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970265.375492:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970265.375524:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102206720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.375530:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788970265.375544:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788970265.375563:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83679680 x1875871102206720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970265.375580:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102206720:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788970265.375592:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836783c0 x1875871102206592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970265.375602:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102206592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970265.378870:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970265.378961:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102206464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.379007:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970265.379098:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102205440:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.379148:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205952 00000100:00100000:0.0:1788970265.379156:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205952 00000100:00100000:1.0:1788970265.379268:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970265.379302:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102205824:0@lo:400:kworker.0 00000100:00100000:1.0:1788970265.379327:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970265.379345:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102206336:0@lo:400:kworker.0 00000100:00100000:1.0:1788970265.379367:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970265.379425:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206464 00000100:00100000:1.0:1788970265.379429:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206464 00000100:00100000:1.0:1788970265.379477:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205824 00000100:00100000:1.0:1788970265.379480:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205824 00000100:00100000:1.0:1788970265.379503:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206336 00000100:00100000:1.0:1788970265.379506:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206336 00000100:00100000:1.0:1788970265.379523:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970265.379532:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102206464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.379562:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970265.379568:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102205824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970265.379621:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102206464:12345-0@lo:400:kworker.0 Request processed in 89us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.379621:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102205824:12345-0@lo:400:kworker.0 Request processed in 52us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970265.379629:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970265.379761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.379796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102205696:0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.379822:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.379851:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102206208:0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.379873:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.379909:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205312 00000100:00100000:3.0:1788970265.379913:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205312 00000100:00100000:3.0:1788970265.379939:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205696 00000100:00100000:3.0:1788970265.379942:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205696 00000100:00100000:3.0:1788970265.379954:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206208 00000100:00100000:3.0:1788970265.379956:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206208 00000100:00100000:3.0:1788970265.379970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970265.379976:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102205312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.380008:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102205312:12345-0@lo:400:kworker.0 Request processed in 32us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.380014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970265.380029:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970265.380035:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102205696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.380065:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102205696:12345-0@lo:400:kworker.0 Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.380081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970265.380101:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788970265.380107:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102206208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.380135:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102206208:12345-0@lo:400:kworker.0 Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.380142:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788970265.381513:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836dda40 x1875871102205696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970265.381544:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102205696:0@lo:400:kworker.0 00010000:00080000:3.0:1788970265.381601:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836ded00 x1875871102206208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970265.381611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102206208:0@lo:400:kworker.0 00000100:00080000:3.0:1788970265.381715:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970265.381722:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970265.384303:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970265.384369:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970265.384485:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102206336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.384816:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102206336:12345-0@lo:400:kworker.0 Request processed in 437us (5446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.384824:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970265.384840:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970265.384849:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5958b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102205952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.384884:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5958b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102205952:12345-0@lo:400:kworker.0 Request processed in 38us (6027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.384891:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970265.384925:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102205184 00000100:00100000:0.0:1788970265.384937:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102205184 00000100:00100000:0.0:1788970265.384994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788970265.385001:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.385066:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102205184:12345-0@lo:400:kworker.0 Request processed in 65us (5305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.385501:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788970265.385560:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836dcb40 x1875871102205952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970265.385577:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102205952:0@lo:400:kworker.0 00010000:00080000:0.0:1788970265.385594:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836df480 x1875871102206464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970265.385603:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102206464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.385648:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102205184:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.385706:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102205312:0@lo:400:kworker.0 00010000:00080000:0.0:1788970265.385722:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836df0c0 x1875871102205824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970265.385731:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102205824:0@lo:400:kworker.0 00010000:00080000:0.0:1788970265.385745:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836dcf00 x1875871102206336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970265.385754:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102206336:0@lo:400:kworker.0 00010000:00010000:3.0:1788970265.629573:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788970266.204526:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970266.204537:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81ace000 from 4 10000000:01000000:3.0:1788970266.204545:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970266.204604:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.204619:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.204632:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970266.204665:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102206848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.204754:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.204826:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.204979:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206848 00000100:00100000:0.0:1788970266.204989:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206848 00000100:00100000:0.0:1788970266.205061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788970266.205073:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102206848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970266.205091:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970266.205118:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e918 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.205148:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.205162:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.205182:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012400, rc 0) 00000100:00100000:0.0:1788970266.205244:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102206848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.205252:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788970266.205410:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102206848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970266.205429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.205441:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970266.205555:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102206976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.205594:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.205622:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.205691:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102206976 00000100:00100000:0.0:1788970266.205696:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102206976 00000100:00100000:0.0:1788970266.205729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788970266.205737:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102206976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.205900:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102206976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.205907:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788970266.205939:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102206976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.205982:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.206021:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.206051:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.206492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207104 00000100:00100000:0.0:1788970266.206498:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207104 00000100:00100000:0.0:1788970266.206534:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788970266.206542:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102207104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.206652:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102207104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.206660:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788970266.206759:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.215998:0:10444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10444:1875871102207232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.216113:0:10444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.216187:0:10444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970266.216254:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207232 00000100:00100000:1.0:1788970266.216264:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207232 00000100:00100000:1.0:1788970266.216326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788970266.216337:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10444:x1875871102207232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970266.216522:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10444:x1875871102207232:12345-0@lo:502:llog_process_th.0 Request processed in 186us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970266.216531:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788970266.216764:0:10444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10444:1875871102207232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970266.216804:0:10444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970266.216827:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970266.216830:0:10444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788970266.216840:0:10444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d81ace000 00000020:00000080:3.0:1788970266.216843:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788970266.216944:0:10444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10444:1875871102207360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.216985:0:10444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.217020:0:10444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.221726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207360 00000100:00100000:0.0:1788970266.221754:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207360 00000100:00100000:0.0:1788970266.222488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788970266.222505:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10444:x1875871102207360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970266.223940:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:10444:x1875871102207360:12345-0@lo:502:llog_process_th.0 Request processed in 1430us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.223956:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788970266.236231:0:10444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10444:1875871102207360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970266.236306:0:10444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970266.236320:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970266.236323:0:10444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788970266.236329:0:10444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788970266.242051:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788970266.242109:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970266.242125:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.242143:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970266.242155:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970266.242159:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eaed7c000 from 4 10000000:01000000:0.0:1788970266.242162:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970266.242231:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.242241:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.242255:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970266.242289:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.242414:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970266.242472:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.245436:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207488 00000100:00100000:3.0:1788970266.245479:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207488 00000100:00100000:3.0:1788970266.245573:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788970266.245589:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102207488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970266.245612:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970266.245636:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e926 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.245673:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.245688:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.245700:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a800, rc 0) 00000100:00100000:3.0:1788970266.245810:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102207488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.245831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788970266.249528:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970266.249574:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.249591:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970266.249700:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.249784:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970266.249835:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.249863:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207616 00000100:00100000:0.0:1788970266.249871:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207616 00000100:00100000:0.0:1788970266.249982:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788970266.249993:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102207616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.250133:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102207616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.250141:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788970266.254619:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.254710:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.254806:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970266.254866:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.255040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207744 00000100:00100000:3.0:1788970266.255050:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207744 00000100:00100000:3.0:1788970266.255118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788970266.255129:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102207744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.255281:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102207744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.255290:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788970266.258421:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102207744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970266.281880:0:10451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10451:1875871102207872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970266.283659:0:10451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970266.285660:0:10451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82410240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970266.287301:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102207872 00000100:00100000:2.0:1788970266.287320:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102207872 00000100:00100000:2.0:1788970266.287564:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788970266.287577:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10451:x1875871102207872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970266.287799:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10451:x1875871102207872:12345-0@lo:502:llog_process_th.0 Request processed in 224us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970266.287808:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788970266.288299:0:10451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10451:1875871102207872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970266.288345:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970266.288356:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970266.288359:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788970266.288367:0:10451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7eaed7c000 00000020:00000080:1.0:1788970266.288997:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788970266.292248:0:10451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10451:1875871102208000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970266.292415:0:10451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970266.292472:0:10451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82410240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.292869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208000 00000100:00100000:0.0:1788970266.292882:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208000 00000100:00100000:0.0:1788970266.292960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788970266.292974:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10451:x1875871102208000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970266.293163:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:10451:x1875871102208000:12345-0@lo:502:llog_process_th.0 Request processed in 192us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.293181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788970266.294950:0:10451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10451:1875871102208000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970266.295012:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970266.295024:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970266.295027:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788970266.295042:0:10451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788970266.295620:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788970266.295654:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970266.295670:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.295684:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970266.295834:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970266.295838:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebb899800 from 4 10000000:01000000:0.0:1788970266.295842:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970266.295892:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.295902:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.295915:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970266.295944:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.296021:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970266.296069:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.297654:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208128 00000100:00100000:3.0:1788970266.297673:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208128 00000100:00100000:3.0:1788970266.298054:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788970266.298069:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102208128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970266.298103:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970266.298127:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e934 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.298161:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.298184:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.298194:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ac00, rc 0) 00000100:00100000:3.0:1788970266.298297:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102208128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.298304:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788970266.298374:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970266.298443:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.298456:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970266.302891:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.302981:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.303033:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970266.303214:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208256 00000100:00100000:0.0:1788970266.303226:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208256 00000100:00100000:0.0:1788970266.303292:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788970266.303303:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102208256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.303494:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102208256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.303503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788970266.304059:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.304110:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.304193:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.304222:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.304237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208384 00000100:00100000:3.0:1788970266.304242:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208384 00000100:00100000:3.0:1788970266.304272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788970266.304278:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102208384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.304371:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102208384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.304397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788970266.304439:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.304679:0:10456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10456:1875871102208512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.304727:0:10456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.304746:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208512 00000100:00100000:3.0:1788970266.304750:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208512 00000100:00100000:3.0:1788970266.304771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788970266.304776:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10456:x1875871102208512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.304846:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10456:x1875871102208512:12345-0@lo:502:llog_process_th.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.304853:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788970266.304881:0:10456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.304893:0:10456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10456:1875871102208512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970266.304919:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970266.304930:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970266.304933:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788970266.304942:0:10456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7ebb899800 00000020:00000080:3.0:1788970266.304948:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788970266.306461:0:10456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10456:1875871102208640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.307596:0:10456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.307688:0:10456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970266.308007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208640 00000100:00100000:2.0:1788970266.308020:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208640 00000100:00100000:2.0:1788970266.308080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788970266.308091:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10456:x1875871102208640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970266.308286:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:10456:x1875871102208640:12345-0@lo:502:llog_process_th.0 Request processed in 196us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970266.308294:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788970266.309054:0:10456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10456:1875871102208640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970266.309104:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970266.309114:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970266.309117:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788970266.309123:0:10456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788970266.309409:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788970266.309443:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970266.309454:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970266.309468:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970266.309479:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970266.309483:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0d2c000 from 4 10000000:01000000:2.0:1788970266.309486:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970266.309538:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970266.309548:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970266.309558:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970266.309581:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970266.309815:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970266.309861:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.310622:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208768 00000100:00100000:3.0:1788970266.310633:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208768 00000100:00100000:3.0:1788970266.310688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788970266.310813:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102208768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970266.310832:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970266.310853:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e942 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.310884:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.310896:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.310907:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4400, rc 0) 00000100:00100000:3.0:1788970266.310976:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102208768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.310983:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788970266.311042:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970266.311070:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.311080:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970266.312893:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.312978:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.313029:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.313056:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102208896 00000100:00100000:3.0:1788970266.313065:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102208896 00000100:00100000:3.0:1788970266.313120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788970266.313130:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102208896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970266.314442:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102208896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1304us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.314455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788970266.314704:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102208896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.314774:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102209024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970266.314824:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970266.314861:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970266.314879:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209024 00000100:00100000:2.0:1788970266.314887:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209024 00000100:00100000:2.0:1788970266.314942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788970266.314952:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102209024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970266.315054:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102209024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970266.315061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788970266.315102:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102209024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970266.315818:0:10458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10458:1875871102209152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970266.315870:0:10458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970266.315948:0:10458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.315994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209152 00000100:00100000:3.0:1788970266.316002:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209152 00000100:00100000:3.0:1788970266.316082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788970266.316092:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:10458:x1875871102209152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.316288:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:10458:x1875871102209152:12345-0@lo:502:llog_process_th.0 Request processed in 197us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.316297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788970266.316563:0:10458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10458:1875871102209152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970266.316596:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970266.316666:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970266.316675:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788970266.316686:0:10458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7eb0d2c000 00000020:00000080:3.0:1788970266.316754:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788970266.316890:0:10458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10458:1875871102209280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.316931:0:10458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.316957:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209280 00000100:00100000:3.0:1788970266.316961:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209280 00000100:00100000:3.0:1788970266.316992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788970266.317000:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:10458:x1875871102209280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970266.317083:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:10458:x1875871102209280:12345-0@lo:502:llog_process_th.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.317090:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788970266.317135:0:10458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970266.317238:0:10458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:10458:1875871102209280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970266.317258:0:10458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970266.317263:0:10458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970266.317265:0:10458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788970266.317268:0:10458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788970266.317340:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788970266.317369:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970266.317422:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970266.317435:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970266.657248:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970266.909497:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102209408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970266.909563:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970266.909640:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209408 00000100:00100000:0.0:1788970266.909648:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209408 00000100:00100000:0.0:1788970266.909689:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970266.909697:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102209408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970266.909723:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970266.909759:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102209408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970266.909765:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788970266.909800:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5825680 x1875871102209408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970266.909816:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102209408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970266.910280:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102209536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970266.910313:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970266.910377:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209536 00000100:00100000:1.0:1788970266.910411:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209536 00000100:00100000:1.0:1788970266.910446:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970266.910452:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102209536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970266.910464:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970266.910497:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102209536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970266.910502:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788970266.910526:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5824000 x1875871102209536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970266.910537:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102209536:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788970267.676747:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970267.932731:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102209664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970267.932804:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970267.933056:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209664 00000100:00100000:3.0:1788970267.933064:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209664 00000100:00100000:3.0:1788970267.933133:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970267.933142:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102209664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970267.933187:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970267.933244:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102209664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970267.933250:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788970267.933373:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102209664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788970268.703451:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970269.470009:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970269.470045:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102209792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970269.470173:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970269.472785:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209792 00000100:00100000:0.0:1788970269.472808:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209792 00000100:00100000:0.0:1788970269.472906:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788970269.472938:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102209792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970269.472994:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970269.473119:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102209792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (2946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970269.473127:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788970269.474596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102209792:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970269.727279:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970270.407592:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970270.407678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970270.407737:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970270.407758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970270.408268:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224640 00000100:00100000:1.0:1788970270.408280:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224640 00000100:00100000:1.0:1788970270.408330:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 273 00000100:00100000:1.0:1788970270.408341:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082224640:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970270.408650:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082224640:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 309us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970270.408658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 273 00000100:00100000:1.0:1788970270.410374:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225152 00000100:00100000:1.0:1788970270.410400:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225152 00000100:00100000:1.0:1788970270.410465:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:1.0:1788970270.410485:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082225152:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970270.410554:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082225152:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 73us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970270.410562:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00080000:1.0:1788970270.410582:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970270.411709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970270.413413:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224896 00000100:00100000:2.0:1788970270.413427:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224896 00000100:00100000:2.0:1788970270.413493:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082224768 00000100:00100000:2.0:1788970270.413497:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082224768 00000100:00100000:2.0:1788970270.413525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1788970270.413536:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082224896:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970270.413611:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082224896:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 76us (5931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.413618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1788970270.413637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1788970270.413643:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082224768:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970270.414278:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225024 00000100:00100000:1.0:1788970270.414285:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225024 00000100:00100000:1.0:1788970270.414314:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:1.0:1788970270.414321:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb59583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082225024:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970270.414350:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb59583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082225024:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970270.414355:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00080000:0.0:1788970270.414437:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970270.414441:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970270.414443:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970270.414806:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082224768:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 1161us (7044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.414814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1788970270.493607:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970270.493631:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102209920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970270.493722:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.493788:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102209920 00000100:00100000:2.0:1788970270.493795:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102209920 00000100:00100000:2.0:1788970270.493850:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970270.493860:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102209920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970270.493891:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970270.493960:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102209920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.493967:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788970270.494009:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83679680 x1875871102209920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970270.494025:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102209920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970270.496641:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102210048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970270.496736:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970270.497155:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210048 00000100:00100000:3.0:1788970270.497164:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210048 00000100:00100000:3.0:1788970270.497297:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970270.497308:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102210048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788970270.497333:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970270.497408:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102210048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970270.497416:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788970270.497456:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e43c0 x1875871102210048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970270.497475:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102210048:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788970270.499353:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970270.505584:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102210176:0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.505656:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970270.505833:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210176 00000100:00100000:0.0:1788970270.505843:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210176 00000100:00100000:0.0:1788970270.505895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788970270.505904:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102210176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.510605:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102210432:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.510684:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.510723:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102210944:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.510748:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.510767:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102211456:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.510786:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.510810:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788970270.510815:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102210560:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.510836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.510855:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102211072:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.510894:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.510927:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210432 00000100:00100000:2.0:1788970270.510935:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210432 00000100:00100000:2.0:1788970270.510983:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788970270.510992:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102210432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.511044:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102210432:12345-0@lo:400:kworker.0 Request processed in 52us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.511051:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788970270.511075:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210944 00000100:00100000:2.0:1788970270.511079:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210944 00000100:00100000:2.0:1788970270.511114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211456 00000100:00100000:2.0:1788970270.511117:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211456 00000100:00100000:2.0:1788970270.511131:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210560 00000100:00100000:2.0:1788970270.511133:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210560 00000100:00100000:2.0:1788970270.511158:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788970270.511166:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102210944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.512830:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102210944:12345-0@lo:400:kworker.0 Request processed in 1658us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.512844:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788970270.512880:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970270.512892:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102211456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.512939:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102211456:12345-0@lo:400:kworker.0 Request processed in 52us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.512945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970270.512958:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970270.512965:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.512994:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102210560:12345-0@lo:400:kworker.0 Request processed in 30us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.513007:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788970270.513043:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970270.513086:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102210560:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.513102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102210432:0@lo:400:kworker.0 00010000:00080000:2.0:1788970270.513115:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836df0c0 x1875871102210944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970270.513125:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102210944:0@lo:400:kworker.0 00010000:00080000:2.0:1788970270.513135:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836dcb40 x1875871102211456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970270.513154:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102211456:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.514419:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102210304:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.514475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.514517:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102210816:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.514539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.514557:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102211328:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.514576:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.514600:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788970270.514606:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102210688:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.514628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970270.515377:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102210176:12345-0@lo:400:kworker.0 Request processed in 9470us (9717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.515402:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788970270.515561:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102211200:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.515599:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.515643:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211072 00000100:00100000:3.0:1788970270.515888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102210176:0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.515919:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210688 00000100:00100000:3.0:1788970270.515923:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210688 00000100:00100000:3.0:1788970270.515970:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970270.515979:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102210688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.516046:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102210688:12345-0@lo:400:kworker.0 Request processed in 67us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970270.516052:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970270.516075:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211200 00000100:00100000:3.0:1788970270.516078:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211200 00000100:00100000:3.0:1788970270.516114:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970270.516121:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102211200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.516584:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211072 00000100:00100000:2.0:1788970270.516622:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970270.516629:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102211072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.521909:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102211072:12345-0@lo:400:kworker.0 Request processed in 5270us (11004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.521926:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970270.521982:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210304 00000100:00100000:2.0:1788970270.521992:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210304 00000100:00100000:2.0:1788970270.522032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102210816 00000100:00100000:2.0:1788970270.522035:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102210816 00000100:00100000:2.0:1788970270.522055:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211328 00000100:00100000:2.0:1788970270.522057:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211328 00000100:00100000:2.0:1788970270.522074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788970270.522082:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102210304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.522659:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102211200:12345-0@lo:400:kworker.0 Request processed in 6246us (6768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970270.522668:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788970270.522700:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970270.522704:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970270.522740:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102210688:0@lo:400:kworker.0 00010000:00080000:3.0:1788970270.522929:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836de940 x1875871102211200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970270.522942:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102211200:0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.522959:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102210304:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.523997:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102210304:12345-0@lo:400:kworker.0 Request processed in 1910us (9516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.524009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788970270.524039:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970270.524053:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102210816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.524122:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102210816:12345-0@lo:400:kworker.0 Request processed in 75us (9581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.524128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970270.524151:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788970270.524159:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102211328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.524877:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102210816:0@lo:400:kworker.0 00000100:00100000:3.0:1788970270.524898:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102211328:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.525107:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102211328:12345-0@lo:400:kworker.0 Request processed in 29us (9610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.525117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788970270.525198:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836de1c0 x1875871102211072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970270.525212:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102211072:0@lo:400:kworker.0 00010000:00010000:3.0:1788970270.750420:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970271.772880:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788970271.830184:0:10701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788970272.031836:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970272.031846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102211712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970272.031853:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102211584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970272.033342:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970272.033425:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211584 00000100:00100000:1.0:1788970272.033434:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211584 00000100:00100000:1.0:1788970272.033496:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970272.033506:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5827c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102211584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970272.033534:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970272.033578:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5827c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102211584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.033585:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788970272.033605:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970272.033638:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5827480 x1875871102211584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970272.033675:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102211584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970272.037328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970272.037534:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211712 00000100:00100000:1.0:1788970272.037543:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211712 00000100:00100000:1.0:1788970272.037593:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970272.037603:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102211712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970272.037628:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970272.037679:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102211712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.037686:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788970272.037707:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788970272.044099:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5824f00 x1875871102211712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970272.044152:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5824f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102211712:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788970272.798515:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970273.054514:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102211840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970273.054611:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970273.054666:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211840 00000100:00100000:1.0:1788970273.054679:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211840 00000100:00100000:1.0:1788970273.054745:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788970273.054757:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102211840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970273.054804:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970273.054875:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102211840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970273.054882:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788970273.055472:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102211840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788970273.820887:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970274.592960:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970274.592988:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102211968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970274.593063:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970274.593226:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102211968 00000100:00100000:0.0:1788970274.593237:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102211968 00000100:00100000:0.0:1788970274.593307:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788970274.593318:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102211968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970274.593353:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970274.593450:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102211968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970274.593457:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788970274.593556:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102211968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788970274.846469:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970275.547551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970275.547579:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970275.547604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970275.547621:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970275.547662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970275.547692:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225408 00000100:00100000:1.0:1788970275.547709:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225408 00000100:00100000:1.0:1788970275.547761:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225536 00000100:00100000:1.0:1788970275.547764:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225536 00000100:00100000:1.0:1788970275.547785:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:1.0:1788970275.547794:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082225408:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970275.547867:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082225408:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970275.547874:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:1.0:1788970275.547890:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:1.0:1788970275.547897:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082225536:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970275.547920:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082225536:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970275.547926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:1.0:1788970275.547943:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225664 00000100:00100000:1.0:1788970275.547946:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225664 00000100:00100000:1.0:1788970275.547970:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225792 00000100:00100000:1.0:1788970275.547973:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225792 00000100:00100000:1.0:1788970275.547992:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:1.0:1788970275.547998:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082225664:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970275.548022:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082225664:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970275.548028:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:1.0:1788970275.548038:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:1.0:1788970275.548044:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5825680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082225792:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970275.548065:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5825680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082225792:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970275.548077:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:1.0:1788970275.548096:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225280 00000100:00100000:1.0:1788970275.548109:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225280 00000100:00100000:1.0:1788970275.548134:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 275 00000100:00100000:1.0:1788970275.548139:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2401:x1875871082225280:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970275.548164:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2401:x1875871082225280:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970275.548170:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 275 00000100:00080000:1.0:1788970275.548200:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970275.548205:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970275.548207:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970275.548209:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970275.614153:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102212096:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.614227:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.614275:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102212608:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.614300:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.614319:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102213120:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.614339:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.614354:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102213632:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.614374:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616559:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788970275.616578:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102212480:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616638:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616669:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102212992:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616691:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616708:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102213504:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616726:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616767:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102212224:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616789:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102212736:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616865:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102213248:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616902:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788970275.616909:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102212352:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616930:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102212864:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616965:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.616975:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102213376:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.616993:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.617024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212096 00000100:00100000:2.0:1788970275.617031:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212096 00000100:00100000:2.0:1788970275.617074:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788970275.617083:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102212096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.617145:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102212096:12345-0@lo:400:kworker.0 Request processed in 63us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.617151:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788970275.617182:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212608 00000100:00100000:2.0:1788970275.617186:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212608 00000100:00100000:2.0:1788970275.617211:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212352 00000100:00100000:2.0:1788970275.617213:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212352 00000100:00100000:2.0:1788970275.617226:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970275.617231:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102212608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.617263:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102212608:12345-0@lo:400:kworker.0 Request processed in 31us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.617278:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970275.617289:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970275.617294:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102212352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.617327:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102212352:12345-0@lo:400:kworker.0 Request processed in 33us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.617333:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970275.617350:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213120 00000100:00100000:2.0:1788970275.617354:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213120 00000100:00100000:2.0:1788970275.626255:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213632 00000100:00100000:2.0:1788970275.626271:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213632 00000100:00100000:2.0:1788970275.626312:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212992 00000100:00100000:2.0:1788970275.626316:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212992 00000100:00100000:2.0:1788970275.626331:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213504 00000100:00100000:2.0:1788970275.626334:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213504 00000100:00100000:2.0:1788970275.626351:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970275.626362:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102213120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.626475:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102213120:12345-0@lo:400:kworker.0 Request processed in 115us (12134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.626482:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970275.626499:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970275.626504:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102213632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.626530:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102213632:12345-0@lo:400:kworker.0 Request processed in 26us (12154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.626536:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970275.626662:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970275.626668:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102212992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.626704:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102212992:12345-0@lo:400:kworker.0 Request processed in 37us (10012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.626710:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970275.626721:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970275.626726:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102213504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.626750:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102213504:12345-0@lo:400:kworker.0 Request processed in 24us (10023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.626755:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970275.626787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212480 00000100:00100000:2.0:1788970275.626791:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212480 00000100:00100000:2.0:1788970275.626811:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212224 00000100:00100000:2.0:1788970275.626814:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212224 00000100:00100000:2.0:1788970275.626823:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212736 00000100:00100000:2.0:1788970275.626825:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212736 00000100:00100000:2.0:1788970275.626837:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213248 00000100:00100000:2.0:1788970275.626840:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213248 00000100:00100000:2.0:1788970275.626850:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102212864 00000100:00100000:2.0:1788970275.626852:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102212864 00000100:00100000:2.0:1788970275.626863:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213376 00000100:00100000:2.0:1788970275.626866:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213376 00000100:00100000:2.0:1788970275.626878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970275.626884:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102212480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.626914:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102212480:12345-0@lo:400:kworker.0 Request processed in 30us (10277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.626920:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970275.626930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970275.626936:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102212224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.626959:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102212224:12345-0@lo:400:kworker.0 Request processed in 24us (10169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.626970:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970275.626980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970275.626986:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102212736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627012:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102212736:12345-0@lo:400:kworker.0 Request processed in 27us (10163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.627017:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970275.627027:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788970275.627031:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102213248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627052:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102213248:12345-0@lo:400:kworker.0 Request processed in 21us (10168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.627057:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788970275.627066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788970275.627071:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102212864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627092:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102212864:12345-0@lo:400:kworker.0 Request processed in 21us (10126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.627097:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788970275.627118:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970275.627124:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102213376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627146:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102213376:12345-0@lo:400:kworker.0 Request processed in 23us (10152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.627152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970275.627202:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102213760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970275.627234:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970275.627281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102212352:0@lo:400:kworker.0 00010000:00080000:2.0:1788970275.627302:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276fc00 x1875871102212864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102212864:0@lo:400:kworker.0 00010000:00080000:2.0:1788970275.627323:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b1680 x1875871102213376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102213376:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627341:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102212224:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627349:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102212736:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102213248:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627406:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970275.627413:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102213888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970275.627435:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788970275.627461:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970275.627466:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970275.627468:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970275.627470:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970275.627487:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213760 00000100:00100000:2.0:1788970275.627490:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213760 00000100:00100000:2.0:1788970275.627508:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102213888 00000100:00100000:2.0:1788970275.627511:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102213888 00000100:00100000:2.0:1788970275.627521:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970275.627527:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102213760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970275.627548:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970275.627585:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102213760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.627596:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970275.627608:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970275.627613:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102213888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970275.627622:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970275.627645:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102213888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970275.627650:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788970275.627674:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5958f00 x1875871102213888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627687:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102213888:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788970275.627696:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e52c0 x1875871102213760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102213760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970275.627732:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102212480:0@lo:400:kworker.0 00010000:00080000:2.0:1788970275.627744:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b2580 x1875871102212992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627752:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102212992:0@lo:400:kworker.0 00010000:00080000:2.0:1788970275.627760:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b2940 x1875871102213504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627767:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102213504:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627776:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102212096:0@lo:400:kworker.0 00000100:00100000:2.0:1788970275.627786:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102212608:0@lo:400:kworker.0 00010000:00080000:2.0:1788970275.627806:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b0000 x1875871102213120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627813:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102213120:0@lo:400:kworker.0 00010000:00080000:2.0:1788970275.627822:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b21c0 x1875871102213632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970275.627829:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102213632:0@lo:400:kworker.0 00010000:00010000:3.0:1788970275.871938:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970276.909442:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788970277.074249:0:10944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing yml_node 00000100:00100000:2.0:1788970277.148674:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102214016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970277.148743:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970277.148845:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214016 00000100:00100000:1.0:1788970277.148853:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214016 00000100:00100000:1.0:1788970277.148910:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788970277.148920:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102214016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970277.148946:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970277.148989:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102214016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970277.148996:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788970277.149034:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58261c0 x1875871102214016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970277.149052:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102214016:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788970277.149106:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970277.149516:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970277.153014:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102214144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970277.153084:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970277.153190:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214144 00000100:00100000:1.0:1788970277.153199:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214144 00000100:00100000:1.0:1788970277.153258:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788970277.153275:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102214144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970277.153300:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970277.153346:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102214144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970277.153353:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788970277.153454:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970277.153486:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58261c0 x1875871102214144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970277.153642:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102214144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788970277.918669:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970278.176353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102214272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970278.176448:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970278.176563:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214272 00000100:00100000:1.0:1788970278.176570:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214272 00000100:00100000:1.0:1788970278.176622:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788970278.176631:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102214272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970278.176664:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970278.176709:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102214272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970278.176717:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788970278.176792:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102214272:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788970278.942638:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970279.708718:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970279.708744:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102214400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970279.708818:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970279.713884:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214400 00000100:00100000:0.0:1788970279.713900:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214400 00000100:00100000:0.0:1788970279.713978:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788970279.713988:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102214400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970279.714033:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970279.714201:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102214400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (5382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970279.714209:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788970279.717021:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102214400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970279.965120:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970280.652614:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970280.652836:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082225920 00000100:00100000:2.0:1788970280.652848:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082225920 00000100:00100000:2.0:1788970280.652919:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 277 00000100:00100000:2.0:1788970280.652929:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2402:x1875871082225920:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970280.653000:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2402:x1875871082225920:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970280.653006:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 277 00000100:00100000:1.0:1788970280.671009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970280.671660:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226048 00000100:00100000:2.0:1788970280.671670:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226048 00000100:00100000:2.0:1788970280.672007:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:2.0:1788970280.672017:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082226048:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970280.672098:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082226048:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 82us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970280.672105:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00080000:2.0:1788970280.672125:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970280.676795:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970280.677006:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226176 00000100:00100000:1.0:1788970280.677016:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226176 00000100:00080000:3.0:1788970280.677130:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970280.677166:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:1.0:1788970280.677178:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082226176:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970280.677262:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082226176:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 86us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970280.677269:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:2.0:1788970280.681413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970280.681497:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970280.681766:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226304 00000100:00100000:2.0:1788970280.681776:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226304 00000100:00100000:2.0:1788970280.681953:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226432 00000100:00100000:2.0:1788970280.681959:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226432 00000100:00100000:2.0:1788970280.681996:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1788970280.682007:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2399:x1875871082226304:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:2.0:1788970280.682048:0:10104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e85b 00000100:00080000:2.0:1788970280.682059:0:10104:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf423000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970280.682130:0:10104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788970280.682289:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+2:2399:x1875871082226304:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 282us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970280.682296:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1788970280.682327:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1788970280.682333:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2399:x1875871082226432:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:2.0:1788970280.682347:0:10104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e862 00000100:00080000:2.0:1788970280.682354:0:10104:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970280.682377:0:10104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788970280.682468:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+2:2399:x1875871082226432:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 134us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970280.682475:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00080000:2.0:1788970280.682494:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970280.682497:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788970280.683430:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970280.684666:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970280.733702:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970280.733786:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.734202:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102215040:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734232:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.734263:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102215552:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734286:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.734312:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102216064:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734330:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.734374:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788970280.734405:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102214656:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734432:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.734455:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102215168:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734477:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.734494:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102215680:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734526:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970280.734637:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215040 00000100:00100000:0.0:1788970280.734646:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215040 00000100:00100000:2.0:1788970280.734815:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102216192:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.734849:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970280.734904:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215552 00000100:00100000:1.0:1788970280.734909:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215552 00000100:00100000:1.0:1788970280.734948:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216064 00000100:00100000:1.0:1788970280.734951:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216064 00000100:00100000:1.0:1788970280.734975:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215680 00000100:00100000:1.0:1788970280.734984:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215680 00000100:00100000:1.0:1788970280.735000:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216192 00000100:00100000:1.0:1788970280.735002:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216192 00000100:00100000:1.0:1788970280.735017:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970280.735026:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102215552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.736585:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788970280.736603:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102215040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102214784:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737056:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737105:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102215296:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737129:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737149:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102215808:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737170:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102216320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970280.737206:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737233:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788970280.737240:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102214912:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737265:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737285:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102215424:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737304:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737315:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102215936:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.737333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970280.737365:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214528 00000100:00100000:2.0:1788970280.737374:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214528 00000100:00100000:2.0:1788970280.737429:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216320 00000100:00100000:2.0:1788970280.737432:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216320 00000100:00100000:2.0:1788970280.737445:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970280.737451:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102214528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970280.737477:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970280.737598:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102215552:12345-0@lo:400:kworker.0 Request processed in 2571us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970280.737608:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970280.737631:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788970280.737639:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d833583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102216064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.738046:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102215040:12345-0@lo:400:kworker.0 Request processed in 1449us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970280.738054:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788970280.738082:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214784 00000100:00100000:0.0:1788970280.738086:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214784 00000100:00100000:0.0:1788970280.738102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215296 00000100:00100000:0.0:1788970280.738104:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215296 00000100:00100000:0.0:1788970280.738117:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215808 00000100:00100000:0.0:1788970280.738120:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215808 00000100:00100000:0.0:1788970280.738130:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215424 00000100:00100000:0.0:1788970280.738132:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215424 00000100:00100000:0.0:1788970280.738143:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215936 00000100:00100000:0.0:1788970280.738145:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215936 00000100:00100000:0.0:1788970280.738158:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970280.738164:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102214784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.738214:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102214784:12345-0@lo:400:kworker.0 Request processed in 50us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970280.738220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970280.738234:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788970280.738240:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102215296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.738265:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102215296:12345-0@lo:400:kworker.0 Request processed in 27us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970280.738271:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788970280.738282:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788970280.738287:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102215808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.738312:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102215808:12345-0@lo:400:kworker.0 Request processed in 25us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970280.738317:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788970280.738328:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970280.738333:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102215424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.738357:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102215424:12345-0@lo:400:kworker.0 Request processed in 25us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970280.738362:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970280.738373:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788970280.738377:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d833592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102215936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970280.738418:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d833592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102215936:12345-0@lo:400:kworker.0 Request processed in 40us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970280.738423:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788970280.738605:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788970280.738616:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102215680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970280.738656:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102215680:12345-0@lo:400:kworker.0 Request processed in 43us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970280.738662:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788970280.738675:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970280.738682:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102216192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970280.739043:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102216192:12345-0@lo:400:kworker.0 Request processed in 360us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970280.739058:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970280.739093:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102215168 00000100:00100000:3.0:1788970280.739098:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102215168 00000100:00100000:3.0:1788970280.739137:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214912 00000100:00100000:3.0:1788970280.739141:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214912 00000100:00100000:3.0:1788970280.739154:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788970280.739160:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102215168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970280.739195:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102215168:12345-0@lo:400:kworker.0 Request processed in 34us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970280.739200:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788970280.739212:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788970280.739218:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102214912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970280.739246:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102214912:12345-0@lo:400:kworker.0 Request processed in 28us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970280.739251:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788970280.739269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102214656 00000100:00100000:3.0:1788970280.739272:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102214656 00000100:00100000:3.0:1788970280.739300:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788970280.739307:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102214656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970280.739340:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102214656:12345-0@lo:400:kworker.0 Request processed in 34us (4907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970280.739346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788970280.739469:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83359680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102214528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2017us (5682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970280.739478:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970280.739493:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970280.739500:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102216320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970280.739516:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970280.739558:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102216320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970280.739563:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970280.739614:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102214912:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.739628:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d92c0 x1875871102215424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.739638:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102215424:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.739647:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8367b0c0 x1875871102215936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.739655:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102215936:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.739668:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102214784:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.739678:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102215296:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.739946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102215808:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.740040:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb595ad00 x1875871102216320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.740056:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102216320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970280.740133:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102214656:0@lo:400:kworker.0 00000100:00100000:2.0:1788970280.740146:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102215168:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.740157:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8367a580 x1875871102215680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.740166:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102215680:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.740176:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83678000 x1875871102216192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.740182:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102216192:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.740192:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276f0c0 x1875871102214528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.740203:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970280.740215:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102215040:0@lo:400:kworker.0 00010000:00080000:2.0:1788970280.740225:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d8b40 x1875871102215552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.740232:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102215552:0@lo:400:kworker.0 00000100:00100000:1.0:1788970280.740362:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d833583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102216064:12345-0@lo:400:kworker.0 Request processed in 2722us (6028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970280.740370:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788970280.740418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970280.740423:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970280.740427:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970280.740429:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970280.745516:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8367bc00 x1875871102216064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970280.745605:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102216064:0@lo:400:kworker.0 00010000:00010000:3.0:1788970280.989302:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970281.027661:0:11128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.42 00010000:00010000:2.0:1788970282.014601:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970282.268705:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102216448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970282.268791:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970282.269080:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102216576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970282.269110:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970282.269263:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216448 00000100:00100000:1.0:1788970282.269272:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216448 00000100:00100000:1.0:1788970282.269319:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216576 00000100:00100000:1.0:1788970282.269323:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216576 00000100:00100000:1.0:1788970282.269338:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788970282.269357:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102216448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970282.269403:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970282.269448:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102216448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970282.269455:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788970282.269472:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970282.269486:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102216576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970282.269497:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970282.269523:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102216576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970282.269529:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788970282.269641:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970282.269672:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5826940 x1875871102216576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970282.269690:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102216576:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788970282.269716:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5825680 x1875871102216448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970282.269726:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102216448:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788970283.038687:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970283.292979:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102216704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970283.293067:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970283.293288:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216704 00000100:00100000:1.0:1788970283.293296:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216704 00000100:00100000:1.0:1788970283.293355:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788970283.293366:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102216704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970283.293425:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970283.293493:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102216704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970283.293500:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788970283.293540:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5825680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102216704:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788970283.438749:0:11225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.42 00010000:00010000:2.0:1788970284.060551:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970284.829967:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102216832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970284.830076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970284.830294:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216832 00000100:00100000:0.0:1788970284.830305:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216832 00000100:00100000:0.0:1788970284.830410:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788970284.830422:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102216832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970284.830465:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970284.836013:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102216832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5584us (5928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970284.836027:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788970284.836335:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102216832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970285.085989:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970285.776271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970285.776329:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970285.776370:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226816 00000100:00100000:0.0:1788970285.776409:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226816 00000100:00100000:0.0:1788970285.776496:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:0.0:1788970285.776509:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082226816:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970285.776679:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082226816:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970285.776687:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00080000:0.0:1788970285.776716:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970285.776754:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970285.777106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226688 00000100:00100000:3.0:1788970285.777112:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226688 00000100:00100000:3.0:1788970285.777154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00100000:3.0:1788970285.777163:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082226688:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970285.777197:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082226688:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970285.777204:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00080000:3.0:1788970285.777221:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970285.777288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226560 00000100:00100000:1.0:1788970285.777293:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226560 00000100:00100000:1.0:1788970285.777331:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 279 00000100:00100000:1.0:1788970285.777339:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2401:x1875871082226560:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970285.777368:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2401:x1875871082226560:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970285.777375:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 279 00000100:00100000:2.0:1788970285.853637:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102216960:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.853740:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.853808:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102217472:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.853862:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.853885:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102217984:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.853908:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.853926:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102218496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.853945:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.853972:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788970285.853978:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102217344:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854000:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854018:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102217856:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854066:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854087:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102218368:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854139:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102217088:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854162:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854181:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102217600:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854200:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854218:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102218112:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854235:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854253:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788970285.854259:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102217216:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854277:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854295:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102217728:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854313:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854323:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102218240:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854340:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.854371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102216960 00000100:00100000:2.0:1788970285.854403:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102216960 00000100:00100000:2.0:1788970285.854459:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788970285.854469:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102216960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854529:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102216960:12345-0@lo:400:kworker.0 Request processed in 60us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.854536:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788970285.854582:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217472 00000100:00100000:2.0:1788970285.854586:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217472 00000100:00100000:2.0:1788970285.854624:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217216 00000100:00100000:2.0:1788970285.854627:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217216 00000100:00100000:2.0:1788970285.854641:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970285.854646:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102217472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854683:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102217472:12345-0@lo:400:kworker.0 Request processed in 36us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.854689:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970285.854701:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970285.854707:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102217216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854739:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102217216:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.854745:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970285.854762:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217984 00000100:00100000:2.0:1788970285.854766:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217984 00000100:00100000:2.0:1788970285.854802:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218496 00000100:00100000:2.0:1788970285.854805:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218496 00000100:00100000:2.0:1788970285.854817:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217856 00000100:00100000:2.0:1788970285.854820:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217856 00000100:00100000:2.0:1788970285.854833:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218368 00000100:00100000:2.0:1788970285.854836:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218368 00000100:00100000:2.0:1788970285.854849:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970285.854854:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102217984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854889:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102217984:12345-0@lo:400:kworker.0 Request processed in 34us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.854894:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970285.854905:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970285.854911:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102218496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854939:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102218496:12345-0@lo:400:kworker.0 Request processed in 29us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.854952:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970285.854964:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970285.854970:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102217856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.854998:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102217856:12345-0@lo:400:kworker.0 Request processed in 29us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855003:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970285.855014:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788970285.855020:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102218368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855065:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102218368:12345-0@lo:400:kworker.0 Request processed in 45us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855071:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788970285.855098:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217344 00000100:00100000:2.0:1788970285.855102:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217344 00000100:00100000:2.0:1788970285.855121:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217088 00000100:00100000:2.0:1788970285.855123:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217088 00000100:00100000:2.0:1788970285.855134:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217600 00000100:00100000:2.0:1788970285.855137:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217600 00000100:00100000:2.0:1788970285.855151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218112 00000100:00100000:2.0:1788970285.855154:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218112 00000100:00100000:2.0:1788970285.855166:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102217728 00000100:00100000:2.0:1788970285.855168:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102217728 00000100:00100000:2.0:1788970285.855181:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218240 00000100:00100000:2.0:1788970285.855184:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218240 00000100:00100000:2.0:1788970285.855199:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788970285.855206:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102217344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855240:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102217344:12345-0@lo:400:kworker.0 Request processed in 34us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855246:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788970285.855267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970285.855273:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102217088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855304:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102217088:12345-0@lo:400:kworker.0 Request processed in 32us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970285.855323:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788970285.855329:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83591a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102217600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855356:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83591a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102217600:12345-0@lo:400:kworker.0 Request processed in 28us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855362:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788970285.855373:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788970285.855404:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102218112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855436:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102218112:12345-0@lo:400:kworker.0 Request processed in 57us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855442:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788970285.855455:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788970285.855461:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102217728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855488:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102217728:12345-0@lo:400:kworker.0 Request processed in 28us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855494:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788970285.855504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788970285.855510:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102218240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855535:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102218240:12345-0@lo:400:kworker.0 Request processed in 26us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.855541:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788970285.855604:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970285.855610:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970285.855612:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970285.855614:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970285.855658:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102217216:0@lo:400:kworker.0 00010000:00080000:2.0:1788970285.855675:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826db0c0 x1875871102217728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.855685:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102217728:0@lo:400:kworker.0 00010000:00080000:2.0:1788970285.855696:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276de00 x1875871102218240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.855704:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102218240:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855716:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102217088:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855726:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102217600:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855735:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102218112:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855784:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102217344:0@lo:400:kworker.0 00010000:00080000:2.0:1788970285.855796:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d92c0 x1875871102217856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.855805:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102217856:0@lo:400:kworker.0 00010000:00080000:2.0:1788970285.855815:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276fc00 x1875871102218368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.855822:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102218368:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855831:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102216960:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.855852:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102217472:0@lo:400:kworker.0 00010000:00080000:2.0:1788970285.855862:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276c3c0 x1875871102217984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.855870:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102217984:0@lo:400:kworker.0 00010000:00080000:2.0:1788970285.855882:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276e1c0 x1875871102218496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.855890:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102218496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970285.861804:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102218752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970285.863080:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970285.863151:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970285.863165:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102218624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970285.863198:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970285.867701:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218752 00000100:00100000:3.0:1788970285.867723:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218752 00000100:00100000:0.0:1788970285.868976:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218624 00000100:00100000:0.0:1788970285.868987:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218624 00000100:00100000:0.0:1788970285.869056:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788970285.869068:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102218624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970285.869110:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970285.869224:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102218624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970285.869232:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788970285.869300:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb595a940 x1875871102218624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970285.869338:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102218624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970285.873729:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970285.873749:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83591680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102218752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970285.873786:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970285.873909:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83591680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102218752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (10835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970285.873915:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788970285.873988:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e7480 x1875871102218752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970285.874014:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102218752:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788970286.001863:0:11323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.42 00010000:00010000:2.0:1788970286.109561:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788970286.881813:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:3.0:1788970286.881903:0:8435:0:(genops.c:885:class_export_put()) final put ffff8a7ebf424000/76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:2.0:1788970286.882265:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf424000/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-OST0000 00000020:00000080:2.0:1788970286.882361:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf423000 for lustre-OST0000 00000001:00100000:3.0:1788970286.886337:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:3.0:1788970286.886347:0:9519:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3b2000/76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:2.0:1788970286.886977:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3b2000/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-OST0001 00000020:00000080:2.0:1788970286.891832:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b6000 for lustre-OST0001 00010000:00010000:3.0:1788970287.138418:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970287.388880:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970287.388918:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102219008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970287.389011:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970287.389103:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102218880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970287.389127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970287.389236:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219008 00000100:00100000:2.0:1788970287.389247:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219008 00000100:00100000:2.0:1788970287.389312:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102218880 00000100:00100000:2.0:1788970287.389314:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102218880 00000100:00100000:2.0:1788970287.389331:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970287.389340:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102219008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970287.389377:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970287.389464:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102219008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970287.389471:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970287.389491:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970287.389497:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb59583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102218880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970287.389508:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970287.389533:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb59583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102218880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970287.389539:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788970287.389650:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788970287.389687:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58261c0 x1875871102219008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970287.389710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102219008:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788970287.389723:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835921c0 x1875871102218880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970287.389735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102218880:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788970287.628141:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 9 12:11:26 EDT 2026 00010000:00010000:2.0:1788970288.156782:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970288.414139:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102219136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970288.414238:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970288.420585:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219136 00000100:00100000:1.0:1788970288.420622:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219136 00000100:00100000:1.0:1788970288.420820:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788970288.420838:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102219136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970288.420891:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970288.421031:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102219136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (6791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970288.421040:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788970288.425960:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102219136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788970289.194656:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970289.950991:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970289.951025:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102219264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970289.951096:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970289.951193:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219264 00000100:00100000:0.0:1788970289.951203:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219264 00000100:00100000:0.0:1788970289.951257:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788970289.951267:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102219264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970289.951306:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970289.951376:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102219264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970289.951415:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788970289.951418:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102219264:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788970290.205938:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970290.884575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970290.884671:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970290.884775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970290.884814:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227200 00000100:00100000:3.0:1788970290.884828:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227200 00000100:00100000:3.0:1788970290.884970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227072 00000100:00100000:3.0:1788970290.884984:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227072 00000100:00100000:3.0:1788970290.885031:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:3.0:1788970290.885043:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082227200:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970290.885140:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082227200:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 100us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970290.885148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:3.0:1788970290.885167:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:3.0:1788970290.885173:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082227072:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970290.885200:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082227072:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970290.885207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00080000:3.0:1788970290.887141:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970290.887156:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970290.891519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082226944 00000100:00100000:0.0:1788970290.891541:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082226944 00000100:00100000:0.0:1788970290.891625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 281 00000100:00100000:0.0:1788970290.891638:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082226944:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970290.891813:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082226944:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 176us (7448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.891821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 281 00000100:00100000:0.0:1788970290.977535:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102219392:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.977641:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.977705:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102219904:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.977738:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.977770:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102220416:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.977798:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.977821:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102220928:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.977844:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.977876:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788970290.977883:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102219520:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.977911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970290.981072:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219904 00000100:00100000:1.0:1788970290.981093:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219904 00000100:00100000:1.0:1788970290.981175:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970290.981187:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102219904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970290.981307:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102219904:12345-0@lo:400:kworker.0 Request processed in 122us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970290.981315:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970290.981693:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102219776:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.981735:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102220032:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.981776:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.981808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219520 00000100:00100000:0.0:1788970290.981814:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219520 00000100:00100000:1.0:1788970290.981829:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.981858:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220032 00000100:00100000:1.0:1788970290.981859:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102220288:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.981862:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220032 00000100:00100000:0.0:1788970290.981906:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219776 00000100:00100000:0.0:1788970290.981909:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219776 00000100:00100000:0.0:1788970290.981940:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788970290.981947:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102219520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.981986:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102219520:12345-0@lo:400:kworker.0 Request processed in 39us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.982002:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788970290.982018:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788970290.982024:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102220032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.982053:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102220032:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.982059:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788970290.982068:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.982074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788970290.982081:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102219776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970290.982103:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102220800:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.982114:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102219776:12345-0@lo:400:kworker.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.982122:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788970290.982134:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.982149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219392 00000100:00100000:0.0:1788970290.982154:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219392 00000100:00100000:0.0:1788970290.982185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788970290.982191:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102219776:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.982196:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102219392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970290.982216:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788970290.982227:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102219648:0@lo:400:kworker.0 00000100:00100000:1.0:1788970290.982255:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970290.982275:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102220160:0@lo:400:kworker.0 00000100:00100000:1.0:1788970290.982308:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970290.982327:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102220672:0@lo:400:kworker.0 00000100:00100000:1.0:1788970290.982351:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970290.982364:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102221184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970290.982476:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220160 00000100:00100000:2.0:1788970290.982482:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220160 00000100:00100000:2.0:1788970290.982512:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220672 00000100:00100000:2.0:1788970290.982515:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220672 00000100:00100000:2.0:1788970290.982533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788970290.982541:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102220160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.983479:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102219392:12345-0@lo:400:kworker.0 Request processed in 1280us (5832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.983490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788970290.983549:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220416 00000100:00100000:0.0:1788970290.983555:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220416 00000100:00100000:0.0:1788970290.983597:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220928 00000100:00100000:0.0:1788970290.983610:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220928 00000100:00100000:0.0:1788970290.983627:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220288 00000100:00100000:0.0:1788970290.983630:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220288 00000100:00100000:0.0:1788970290.983642:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220800 00000100:00100000:0.0:1788970290.983645:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220800 00000100:00100000:0.0:1788970290.983661:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788970290.983667:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102220416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.983717:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102220416:12345-0@lo:400:kworker.0 Request processed in 50us (5918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.983724:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788970290.983736:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788970290.983743:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102220928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.983775:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102220928:12345-0@lo:400:kworker.0 Request processed in 33us (5931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.983781:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788970290.983793:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788970290.983799:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102220288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.983828:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102220288:12345-0@lo:400:kworker.0 Request processed in 29us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.983833:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788970290.983844:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970290.983850:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5825680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102220800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.983876:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5825680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102220800:12345-0@lo:400:kworker.0 Request processed in 27us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.983882:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970290.983908:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788970290.983987:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e93593840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102220672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.984042:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e93593840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102220672:12345-0@lo:400:kworker.0 Request processed in 128us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.984050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788970290.984073:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970290.984078:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970290.984081:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970290.984084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970290.984100:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102219648 00000100:00100000:0.0:1788970290.984104:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102219648 00000100:00100000:0.0:1788970290.984136:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788970290.984143:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102219648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.984181:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102219648:12345-0@lo:400:kworker.0 Request processed in 39us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.984187:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788970290.984766:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102220032:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.984782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102220544:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.984825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.984861:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102220544 00000100:00100000:0.0:1788970290.984865:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102220544 00000100:00100000:0.0:1788970290.984900:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788970290.984907:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102220544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.986087:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102220544:12345-0@lo:400:kworker.0 Request processed in 1171us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.986100:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788970290.986143:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970290.986179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102220544:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.986202:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102221056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970290.987061:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970290.987125:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221056 00000100:00100000:0.0:1788970290.987133:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221056 00000100:00100000:0.0:1788970290.987187:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788970290.987198:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102221056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970290.987313:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788970290.987364:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb595ad00 x1875871102220288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970290.987411:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102220288:0@lo:400:kworker.0 00010000:00080000:1.0:1788970290.987429:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7bc00 x1875871102220800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970290.987438:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102220800:0@lo:400:kworker.0 00002000:00000024:0.0:1788970290.987482:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970290.987530:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102221056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 334us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.987538:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788970290.987556:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221184 00000100:00100000:0.0:1788970290.987560:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221184 00000100:00100000:0.0:1788970290.987583:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970290.987594:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102219648:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.987595:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102221184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970290.987611:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788970290.987618:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7b480 x1875871102220672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970290.987629:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102220672:0@lo:400:kworker.0 00010000:00080000:1.0:1788970290.987648:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e6d00 x1875871102221184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970290.987650:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102221184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970290.987666:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970290.987678:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102221184:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788970290.987708:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7ad00 x1875871102221056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970290.987726:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102221056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970290.987739:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102219392:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.987752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102219904:0@lo:400:kworker.0 00010000:00080000:0.0:1788970290.987764:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c783c0 x1875871102220416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970290.987781:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102220416:0@lo:400:kworker.0 00010000:00080000:0.0:1788970290.987797:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c78f00 x1875871102220928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970290.987807:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102220928:0@lo:400:kworker.0 00000100:00100000:0.0:1788970290.987846:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102219520:0@lo:400:kworker.0 00000100:00100000:2.0:1788970290.988038:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102220160:12345-0@lo:400:kworker.0 Request processed in 5495us (5726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970290.988056:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788970290.988099:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb595b480 x1875871102220160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970290.988110:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102220160:0@lo:400:kworker.0 00010000:00010000:1.0:1788970291.228608:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970292.259331:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970292.511600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970292.511628:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83591e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102221312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970292.511714:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970292.511789:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970292.511799:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102221440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970292.511824:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970292.511857:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221312 00000100:00100000:1.0:1788970292.511867:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221312 00000100:00100000:1.0:1788970292.511934:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221440 00000100:00100000:1.0:1788970292.511937:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221440 00000100:00100000:1.0:1788970292.511957:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970292.511967:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102221312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970292.512011:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970292.512057:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102221312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970292.512064:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970292.512084:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970292.512089:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102221440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970292.512098:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970292.512122:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102221440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970292.512127:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788970292.512148:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970292.512178:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83517480 x1875871102221440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970292.512199:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102221440:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788970292.512227:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83591e00 x1875871102221312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970292.512248:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83591e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102221312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788970293.277525:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970293.532842:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102221568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970293.532947:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970293.535307:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221568 00000100:00100000:1.0:1788970293.535326:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221568 00000100:00100000:1.0:1788970293.535425:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788970293.535437:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102221568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970293.535490:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970293.535661:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102221568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 227us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970293.535670:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788970293.538910:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102221568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788970294.300561:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970295.068880:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102221696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970295.069119:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970295.069425:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221696 00000100:00100000:0.0:1788970295.069438:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221696 00000100:00100000:0.0:1788970295.069507:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788970295.069518:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102221696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970295.069564:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970295.069628:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102221696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970295.069635:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970295.069746:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102221696:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970295.332571:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970296.006606:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970296.006641:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227328 00000100:00100000:3.0:1788970296.006651:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227328 00000100:00100000:3.0:1788970296.006706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 283 00000100:00100000:3.0:1788970296.006717:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2402:x1875871082227328:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970296.006783:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2402:x1875871082227328:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970296.006790:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 283 00000100:00100000:3.0:1788970296.016280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970296.016317:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970296.016355:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227584 00000100:00100000:3.0:1788970296.016365:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227584 00000100:00100000:3.0:1788970296.016443:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227456 00000100:00100000:3.0:1788970296.016446:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227456 00000100:00100000:3.0:1788970296.016473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:3.0:1788970296.016483:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082227584:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970296.016567:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082227584:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970296.016575:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:3.0:1788970296.016593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00100000:3.0:1788970296.016600:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082227456:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970296.016626:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082227456:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970296.016631:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00080000:3.0:1788970296.016651:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970296.016655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970296.095526:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102221824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970296.095599:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095663:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102222336:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.095702:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095724:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102222848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.095725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102221952:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.095748:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970296.095755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095766:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102223360:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.095776:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102222464:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.095783:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970296.095796:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095800:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788970296.095806:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102222208:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.095813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102222976:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.095825:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970296.095828:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095841:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102222720:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.095843:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788970296.095847:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102222080:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.095867:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095883:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221824 00000100:00100000:0.0:1788970296.095885:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102222592:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.095890:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221824 00000100:00100000:0.0:1788970296.095914:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970296.095929:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102223104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.095946:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970296.095948:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788970296.095966:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102221824:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970296.095988:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222848 00000100:00100000:0.0:1788970296.095992:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222848 00002000:00000024:2.0:1788970296.095996:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970296.096018:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223360 00000100:00100000:0.0:1788970296.096020:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223360 00000100:00100000:2.0:1788970296.096034:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102221824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.096036:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222976 00000100:00100000:0.0:1788970296.096038:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222976 00000100:00100000:2.0:1788970296.096046:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970296.096067:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788970296.096075:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222336 00000100:00100000:0.0:1788970296.096075:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102222848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.096079:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222336 00000100:00100000:2.0:1788970296.096094:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222080 00000100:00100000:2.0:1788970296.096097:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222080 00000100:00100000:2.0:1788970296.096107:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222592 00000100:00100000:0.0:1788970296.096107:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102222848:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970296.096109:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222592 00000100:00100000:0.0:1788970296.096113:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788970296.096119:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223104 00000100:00100000:2.0:1788970296.096122:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223104 00000100:00100000:0.0:1788970296.096124:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970296.096129:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102223360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.096133:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788970296.096138:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83591e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102222336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.096152:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102223360:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.096157:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970296.096164:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83591e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102222336:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.096168:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788970296.096170:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788970296.096173:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102222976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.096179:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788970296.096184:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.096200:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102222976:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.096205:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788970296.096221:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102222080:12345-0@lo:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.096222:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102221952 00000100:00100000:0.0:1788970296.096225:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102221952 00000100:00100000:2.0:1788970296.096238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788970296.096250:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788970296.096255:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102222592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.096255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788970296.096267:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102221952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.096284:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102222592:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970296.096290:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788970296.096291:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102221952:12345-0@lo:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.096296:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788970296.096299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970296.096304:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102223104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.096322:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222464 00000100:00100000:0.0:1788970296.096325:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222464 00000100:00100000:2.0:1788970296.096339:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102223104:12345-0@lo:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970296.096345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788970296.096347:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222208 00000100:00100000:0.0:1788970296.096349:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222208 00000100:00100000:0.0:1788970296.096360:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970296.096365:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102222464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970296.096724:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970296.096750:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102223232:0@lo:400:kworker.0 00000100:00100000:1.0:1788970296.096777:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788970296.096810:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7b480 x1875871102222848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970296.096823:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102222848:0@lo:400:kworker.0 00010000:00080000:1.0:1788970296.096834:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c64f00 x1875871102223360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970296.096842:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102223360:0@lo:400:kworker.0 00000100:00100000:1.0:1788970296.096852:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102222336:0@lo:400:kworker.0 00010000:00080000:1.0:1788970296.096862:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835152c0 x1875871102221824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970296.096888:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102221824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970296.096918:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102222720 00000100:00100000:1.0:1788970296.096922:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102222720 00000100:00100000:1.0:1788970296.096971:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223232 00000100:00100000:1.0:1788970296.096975:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223232 00000100:00100000:1.0:1788970296.096994:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788970296.097000:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102222720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970296.097038:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102222720:12345-0@lo:400:kworker.0 Request processed in 38us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970296.097044:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788970296.097066:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788970296.097074:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102223232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970296.097100:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102223232:12345-0@lo:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970296.097105:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1788970296.097133:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c78f00 x1875871102222720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970296.097142:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102222720:0@lo:400:kworker.0 00010000:00080000:1.0:1788970296.097152:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c67c00 x1875871102223232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970296.097160:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102223232:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.097422:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788970296.097433:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102222208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.097487:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102222208:12345-0@lo:400:kworker.0 Request processed in 57us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970296.097493:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788970296.097514:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970296.097519:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970296.097522:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970296.097524:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970296.097599:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102222464:12345-0@lo:400:kworker.0 Request processed in 1233us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970296.097605:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970296.097637:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970296.097648:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102223488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970296.097679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970296.097839:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102222208:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.098855:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102222080:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.098869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102222592:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.098881:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102223104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.098891:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102221952:0@lo:400:kworker.0 00000100:00100000:0.0:1788970296.098900:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102222464:0@lo:400:kworker.0 00010000:00080000:0.0:1788970296.098910:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7bc00 x1875871102222976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970296.098920:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102222976:0@lo:400:kworker.0 00000100:00100000:2.0:1788970296.100275:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223488 00000100:00100000:2.0:1788970296.100289:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223488 00000100:00100000:2.0:1788970296.100430:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788970296.100440:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102223488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970296.100466:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970296.100565:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102223488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970296.100572:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788970296.100654:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83517840 x1875871102223488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970296.100672:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102223488:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788970296.350172:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970297.373539:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970297.631325:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102223616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970297.631405:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970297.631483:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223616 00000100:00100000:3.0:1788970297.631491:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223616 00000100:00100000:3.0:1788970297.631539:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970297.631548:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102223616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788970297.631577:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970297.631618:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102223616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970297.631635:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788970297.631672:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836de580 x1875871102223616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970297.631688:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102223616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970297.632555:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102223744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970297.632596:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970297.634500:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223744 00000100:00100000:2.0:1788970297.634513:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223744 00000100:00100000:2.0:1788970297.634573:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788970297.634582:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102223744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970297.634605:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970297.640573:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102223744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5983us (7967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970297.640603:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788970297.640787:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c66580 x1875871102223744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970297.640811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102223744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788970298.396552:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970298.654899:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102223872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970298.654996:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970298.655077:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102223872 00000100:00100000:3.0:1788970298.655085:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102223872 00000100:00100000:3.0:1788970298.655133:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970298.655143:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102223872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970298.655177:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970298.655227:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102223872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970298.655234:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970298.655281:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102223872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788970299.421360:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970300.191087:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970300.191111:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102224000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970300.191180:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970300.191296:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224000 00000100:00100000:0.0:1788970300.191304:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224000 00000100:00100000:0.0:1788970300.191359:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970300.191368:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102224000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970300.191415:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970300.191460:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102224000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970300.191466:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788970300.191550:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102224000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788970300.448829:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970301.122888:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970301.122944:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970301.122982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970301.123105:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227968 00000100:00100000:2.0:1788970301.123115:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227968 00000100:00100000:2.0:1788970301.123176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227840 00000100:00100000:2.0:1788970301.123180:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227840 00000100:00100000:2.0:1788970301.123217:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:2.0:1788970301.123227:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082227968:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970301.123303:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082227968:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970301.123310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:2.0:1788970301.123326:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:2.0:1788970301.123333:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082227840:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970301.123359:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082227840:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970301.123365:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00080000:3.0:1788970301.124000:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970301.124005:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970301.124157:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082227712 00000100:00100000:1.0:1788970301.124172:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082227712 00000100:00100000:1.0:1788970301.124496:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 285 00000100:00100000:1.0:1788970301.124506:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082227712:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970301.124562:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082227712:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 58us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.124568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 285 00000100:00100000:3.0:1788970301.212892:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102224256:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.212976:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213045:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102224768:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213077:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102225280:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213145:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788970301.213150:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102224384:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213169:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213184:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102224896:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213427:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213458:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102225408:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213482:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213499:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970301.213507:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102225792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970301.213529:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970301.213535:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224256 00000100:00100000:1.0:1788970301.213542:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224256 00000100:00100000:3.0:1788970301.213553:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102225920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970301.213570:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970301.213575:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224768 00000100:00100000:1.0:1788970301.213578:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224768 00000100:00100000:3.0:1788970301.213593:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224384 00000100:00100000:3.0:1788970301.213597:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224384 00000100:00100000:1.0:1788970301.213600:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225280 00000100:00100000:1.0:1788970301.213602:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225280 00000100:00100000:1.0:1788970301.213611:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224896 00000100:00100000:1.0:1788970301.213613:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224896 00000100:00100000:3.0:1788970301.213621:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788970301.213623:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225408 00000100:00100000:1.0:1788970301.213625:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225408 00000100:00100000:3.0:1788970301.213629:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102224384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.213635:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788970301.213653:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102224256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213675:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102224384:12345-0@lo:400:kworker.0 Request processed in 46us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.213680:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102224256:12345-0@lo:400:kworker.0 Request processed in 29us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.213687:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788970301.213689:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788970301.213702:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788970301.213708:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102224768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213709:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225792 00000100:00100000:3.0:1788970301.213712:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225792 00000100:00100000:3.0:1788970301.213728:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225920 00000100:00100000:3.0:1788970301.213731:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225920 00000100:00100000:1.0:1788970301.213733:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102224768:12345-0@lo:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.213738:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788970301.213744:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970301.213747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788970301.213749:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102225792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970301.213752:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102225280:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788970301.213770:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970301.213782:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102225280:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.213788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788970301.213799:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788970301.213800:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102225792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.213805:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102224896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213806:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970301.213830:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970301.213830:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102224896:12345-0@lo:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970301.213836:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102225920:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970301.213836:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00002000:00000024:3.0:1788970301.213844:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970301.213846:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788970301.213851:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102225408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213865:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102225920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970301.213871:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970301.213871:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102225408:12345-0@lo:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.213876:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788970301.213888:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970301.213892:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970301.213894:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970301.213894:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102224128:0@lo:400:kworker.0 00010000:00080000:3.0:1788970301.213927:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83517480 x1875871102225920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970301.213933:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.213946:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102225920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970301.213954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102224640:0@lo:400:kworker.0 00010000:00080000:3.0:1788970301.213957:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83517c00 x1875871102225792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970301.213967:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83517c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102225792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970301.213974:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970301.213987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102225152:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.213995:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224640 00000100:00100000:3.0:1788970301.213998:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224640 00000100:00100000:1.0:1788970301.214005:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.214018:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970301.214020:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102225664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970301.214023:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214036:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970301.214049:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102224640:12345-0@lo:400:kworker.0 Request processed in 26us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970301.214055:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970301.214058:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102224640:0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214066:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788970301.214073:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102224512:0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214104:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970301.214120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102225024:0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214139:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970301.214154:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102225536:0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214172:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970301.214173:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224512 00000100:00100000:2.0:1788970301.214177:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224512 00000100:00100000:1.0:1788970301.214194:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225152 00000100:00100000:1.0:1788970301.214197:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225152 00000100:00100000:1.0:1788970301.214222:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225664 00000100:00100000:1.0:1788970301.214225:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225664 00000100:00100000:1.0:1788970301.214234:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225024 00000100:00100000:1.0:1788970301.214236:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225024 00000100:00100000:1.0:1788970301.214245:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102225536 00000100:00100000:1.0:1788970301.214247:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102225536 00000100:00100000:1.0:1788970301.214257:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970301.214264:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102225152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214297:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102225152:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.214303:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970301.214313:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788970301.214313:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102224128 00000100:00100000:0.0:1788970301.214317:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102224128 00000100:00100000:1.0:1788970301.214318:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102225664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214342:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102225664:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970301.214342:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788970301.214348:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788970301.214349:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102224128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214357:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970301.214362:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102225024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970301.214396:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102224128:12345-0@lo:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970301.214403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788970301.214404:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102225024:12345-0@lo:400:kworker.0 Request processed in 42us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970301.214418:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970301.214427:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788970301.214433:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102225536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.214461:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102225536:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970301.214463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788970301.214470:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102224512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970301.214518:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102224512:12345-0@lo:400:kworker.0 Request processed in 49us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970301.214524:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788970301.214568:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102224384:0@lo:400:kworker.0 00010000:00080000:2.0:1788970301.214578:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8367a580 x1875871102224896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970301.214586:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102224896:0@lo:400:kworker.0 00010000:00080000:2.0:1788970301.214595:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef0a1c0 x1875871102225408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970301.214603:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102225408:0@lo:400:kworker.0 00000100:00100000:2.0:1788970301.214614:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102224256:0@lo:400:kworker.0 00000100:00100000:2.0:1788970301.214624:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102224768:0@lo:400:kworker.0 00000100:00100000:2.0:1788970301.214634:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102225280:0@lo:400:kworker.0 00000100:00080000:2.0:1788970301.214692:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970301.214721:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102224512:0@lo:400:kworker.0 00010000:00080000:2.0:1788970301.214730:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8367bc00 x1875871102225024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970301.214738:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102225024:0@lo:400:kworker.0 00010000:00080000:2.0:1788970301.214745:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef083c0 x1875871102225536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970301.214752:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102225536:0@lo:400:kworker.0 00000100:00100000:2.0:1788970301.214769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102224128:0@lo:400:kworker.0 00010000:00080000:2.0:1788970301.214778:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83679e00 x1875871102225152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970301.214785:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102225152:0@lo:400:kworker.0 00010000:00080000:2.0:1788970301.214792:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef09e00 x1875871102225664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970301.214798:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102225664:0@lo:400:kworker.0 00000100:00100000:1.0:1788970301.223201:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1788970301.469687:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970302.492866:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970302.752262:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102226048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970302.752376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970302.753675:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970302.753746:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970302.754616:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226048 00000100:00100000:3.0:1788970302.754632:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226048 00000100:00100000:3.0:1788970302.754680:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226176 00000100:00100000:3.0:1788970302.754685:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226176 00000100:00100000:3.0:1788970302.754703:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788970302.754713:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102226048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788970302.754753:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788970302.754864:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58dd680 x1875871102226048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970302.754891:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102226048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970302.759120:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102226048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4353us (6690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970302.759141:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788970302.759195:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788970302.759209:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970302.759243:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970302.759345:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970302.759352:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788970302.759619:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c66940 x1875871102226176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970302.759644:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102226176:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788970303.185150:0:12000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:11:41 (1788970301) === 00010000:00010000:3.0:1788970303.527988:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970303.603928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970303.604054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228096 00000100:00100000:1.0:1788970303.604068:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228096 00000100:00100000:1.0:1788970303.604140:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 287 00000100:00100000:1.0:1788970303.604152:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:8721:x1875871082228096:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970303.604175:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970303.604199:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d694 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970303.604239:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d694 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970303.604251:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d694 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970303.604262:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654c00, rc 0) 00000100:00100000:1.0:1788970303.604327:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8721:x1875871082228096:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970303.604335:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 287 00000100:00100000:0.0:1788970303.613457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.613597:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228224 00000100:00100000:2.0:1788970303.613612:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228224 00000100:00100000:2.0:1788970303.613679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00100000:2.0:1788970303.613692:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8721:x1875871082228224:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970303.615508:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8721:x1875871082228224:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 1808us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.615524:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00100000:2.0:1788970303.619364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.619564:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228352 00000100:00100000:0.0:1788970303.619579:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228352 00000100:00100000:0.0:1788970303.619644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 289 00000100:00100000:0.0:1788970303.619655:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8721:x1875871082228352:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970303.620067:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8721:x1875871082228352:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 411us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.620076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 289 00000100:00100000:3.0:1788970303.624108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.625229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228480 00000100:00100000:2.0:1788970303.625244:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228480 00000100:00100000:2.0:1788970303.625365:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:2.0:1788970303.625377:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8725:x1875871082228480:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970303.625598:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8725:x1875871082228480:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 223us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.625614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:3.0:1788970303.657633:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.657711:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228608 00000100:00100000:0.0:1788970303.658530:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228608 00000100:00100000:2.0:1788970303.658718:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 291 00000100:00100000:2.0:1788970303.658741:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8725:x1875871082228608:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970303.659231:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8725:x1875871082228608:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 490us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.659240:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 291 00000100:00100000:0.0:1788970303.664188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.665552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228736 00000100:00100000:2.0:1788970303.665574:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228736 00000100:00100000:2.0:1788970303.665665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 292 00000100:00100000:2.0:1788970303.665677:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8725:x1875871082228736:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970303.668271:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8725:x1875871082228736:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 2580us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.668293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 292 00000100:00100000:3.0:1788970303.672819:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.676088:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228864 00000100:00100000:2.0:1788970303.676103:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228864 00000100:00100000:2.0:1788970303.676168:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 293 00000100:00100000:2.0:1788970303.676178:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:8721:x1875871082228864:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970303.676192:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970303.676210:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98400/0xc3abfebe76c6e957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d6c5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970303.676236:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98400/0xc3abfebe76c6e957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6c5 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970303.676246:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98400/0xc3abfebe76c6e957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6c5 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970303.676268:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98400, rc 0) 00000100:00100000:2.0:1788970303.676334:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:8721:x1875871082228864:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 157us (3532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.676341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 293 00000100:00100000:3.0:1788970303.683015:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.683488:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082228992 00000100:00100000:2.0:1788970303.683504:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082228992 00000100:00100000:2.0:1788970303.683577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 294 00000100:00100000:2.0:1788970303.683588:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:8721:x1875871082228992:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788970303.683613:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788970303.683636:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788970303.683641:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788970303.683644:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788970303.683647:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788970303.683650:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788970303.692689:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:8721:x1875871082228992:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 9092us (9678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.692703:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 294 00000100:00100000:3.0:1788970303.701750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970303.702132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229120 00000100:00100000:1.0:1788970303.702146:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229120 00000100:00100000:1.0:1788970303.702225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 295 00000100:00100000:1.0:1788970303.702256:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:8721:x1875871082229120:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970303.702280:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970303.702302:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d6cc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970303.702339:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970303.702352:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970303.702361:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:1.0:1788970303.702479:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8721:x1875871082229120:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 225us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970303.702487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 295 00000100:00100000:3.0:1788970303.705204:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.705358:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229248 00000100:00100000:2.0:1788970303.705370:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229248 00000100:00100000:2.0:1788970303.705461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 296 00000100:00100000:2.0:1788970303.705472:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8721:x1875871082229248:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970303.705668:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8721:x1875871082229248:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 197us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.705676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 296 00000100:00100000:2.0:1788970303.707651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.707765:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229376 00000100:00100000:0.0:1788970303.707778:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229376 00000100:00100000:0.0:1788970303.707837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 297 00000100:00100000:0.0:1788970303.707848:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8721:x1875871082229376:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970303.708028:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8721:x1875871082229376:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 181us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.708036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 297 00000100:00100000:3.0:1788970303.712585:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970303.712745:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229504 00000100:00100000:1.0:1788970303.712761:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229504 00000100:00100000:1.0:1788970303.712849:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:1.0:1788970303.712864:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8730:x1875871082229504:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970303.713104:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8730:x1875871082229504:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 242us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970303.713113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:3.0:1788970303.721427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.721741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229632 00000100:00100000:2.0:1788970303.721756:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229632 00000100:00100000:2.0:1788970303.721839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:2.0:1788970303.721851:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8730:x1875871082229632:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970303.722230:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:8730:x1875871082229632:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 380us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.722240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:0.0:1788970303.726040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.726088:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.726120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.726150:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.726187:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229760 00000100:00100000:0.0:1788970303.726200:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229760 00000100:00100000:0.0:1788970303.726238:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230016 00000100:00100000:0.0:1788970303.726241:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230016 00000100:00100000:0.0:1788970303.726249:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230528 00000100:00100000:0.0:1788970303.726251:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230528 00000100:00100000:0.0:1788970303.726288:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230400 00000100:00100000:0.0:1788970303.726311:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230400 00000100:00100000:0.0:1788970303.726335:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:0.0:1788970303.726348:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082230528:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970303.726549:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082230528:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 203us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.726558:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:0.0:1788970303.726580:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:0.0:1788970303.726587:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082230400:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970303.726615:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082230400:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.726622:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:0.0:1788970303.726636:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1788970303.726640:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875871082229760:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788970303.726667:0:10102:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 84179ff9-de03-4594-a7ab-22774d7b8d1d@192.168.203.15@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:0.0:1788970303.726712:0:10102:0:(genops.c:1384:class_connect()) connect: client 84179ff9-de03-4594-a7ab-22774d7b8d1d, cookie 0xc3abfebe76c6e965 00000100:00100000:1.0:1788970303.726827:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1788970303.726834:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875871082230016:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788970303.726851:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 84179ff9-de03-4594-a7ab-22774d7b8d1d@192.168.203.15@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1788970303.726877:0:6525:0:(genops.c:1384:class_connect()) connect: client 84179ff9-de03-4594-a7ab-22774d7b8d1d, cookie 0xc3abfebe76c6e96c 00000004:00100000:1.0:1788970303.726927:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788970303.727072:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8a7d81a39800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970303.727104:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2399:x1875871082230016:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 270us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970303.727112:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000004:00100000:0.0:1788970303.727233:0:10102:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788970303.727304:0:10102:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970303.727330:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2399:x1875871082229760:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 687us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.727337:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00080000:2.0:1788970303.728431:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970303.728438:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970303.742657:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970303.742726:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970303.742759:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970303.742808:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230144 00000100:00100000:3.0:1788970303.742821:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230144 00000100:00100000:3.0:1788970303.742918:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082229888 00000100:00100000:3.0:1788970303.742922:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082229888 00000100:00100000:3.0:1788970303.742940:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230272 00000100:00100000:3.0:1788970303.742943:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230272 00000100:00100000:3.0:1788970303.742959:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970303.742971:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:0:x1875871082230144:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970303.743023:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970303.743132:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:0:x1875871082230144:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 162us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970303.743139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970303.743159:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:3.0:1788970303.743166:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+7:0:x1875871082229888:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970303.743207:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970303.743249:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+7:0:x1875871082229888:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 83us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970303.743255:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:3.0:1788970303.743268:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1788970303.743275:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082230272:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970303.743304:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970303.743328:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082230272:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 53us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970303.743335:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00080000:3.0:1788970303.743357:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970303.743362:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970303.749595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.750131:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230656 00000100:00100000:0.0:1788970303.750144:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230656 00000100:00100000:0.0:1788970303.750221:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970303.750234:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082230656:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788970303.750374:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082230656:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 143us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.750411:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970303.756694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.756753:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.756789:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970303.757287:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230784 00000100:00100000:2.0:1788970303.757301:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230784 00000100:00100000:2.0:1788970303.757351:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082230912 00000100:00100000:2.0:1788970303.757355:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082230912 00000100:00100000:2.0:1788970303.757414:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:2.0:1788970303.757424:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082230784:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970303.757476:0:8442:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 84179ff9-de03-4594-a7ab-22774d7b8d1d@192.168.203.15@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1788970303.757534:0:8442:0:(genops.c:1384:class_connect()) connect: client 84179ff9-de03-4594-a7ab-22774d7b8d1d, cookie 0xc3abfebe76c6e973 00002000:00100000:2.0:1788970303.757550:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 84179ff9-de03-4594-a7ab-22774d7b8d1d/ffff8a7ebf423000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970303.757565:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788970303.757678:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788970303.757735:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf425000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970303.757824:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2399:x1875871082230784:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 399us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.757832:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:2.0:1788970303.757853:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:2.0:1788970303.757857:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082230912:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970303.758190:0:8442:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 84179ff9-de03-4594-a7ab-22774d7b8d1d@192.168.203.15@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1788970303.758213:0:8442:0:(genops.c:1384:class_connect()) connect: client 84179ff9-de03-4594-a7ab-22774d7b8d1d, cookie 0xc3abfebe76c6e97a 00002000:00100000:2.0:1788970303.758219:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 84179ff9-de03-4594-a7ab-22774d7b8d1d/ffff8a7ebf422000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970303.758234:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788970303.758275:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788970303.758291:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf421800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970303.758316:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2399:x1875871082230912:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 458us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970303.758324:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1788970303.758628:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231040 00000100:00100000:3.0:1788970303.758635:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231040 00000100:00100000:3.0:1788970303.758687:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:3.0:1788970303.758695:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082231040:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788970303.758752:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082231040:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 58us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970303.758759:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1788970303.764544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970303.764928:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231168 00000100:00100000:0.0:1788970303.764942:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231168 00000100:00100000:0.0:1788970303.765019:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:0.0:1788970303.765032:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082231168:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788970303.765155:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788970303.765274:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:8721:x1875871082231168:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 244us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970303.765282:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:2.0:1788970303.773007:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102226304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970303.773100:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970303.773431:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226304 00000100:00100000:3.0:1788970303.773443:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226304 00000100:00100000:3.0:1788970303.773521:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788970303.773533:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102226304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970303.773576:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970303.773684:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102226304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970303.773692:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788970303.779338:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102226304:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788970304.540625:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970305.313456:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102226432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970305.313553:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970305.315292:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226432 00000100:00100000:3.0:1788970305.315305:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226432 00000100:00100000:3.0:1788970305.315371:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788970305.315406:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102226432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970305.315443:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970305.315510:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102226432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970305.315517:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788970305.317268:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102226432:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970305.570126:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970306.336510:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102226560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970306.336577:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.336638:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970306.336645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102226688:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.336672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.336712:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226688 00000100:00100000:0.0:1788970306.336714:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226560 00000100:00100000:3.0:1788970306.336719:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226688 00000100:00100000:0.0:1788970306.336719:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226560 00000100:00100000:3.0:1788970306.336758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788970306.336758:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788970306.336766:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970306.336766:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102226560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970306.336792:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970306.336818:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102226688:12345-0@lo:400:kworker.0 Request processed in 52us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970306.336819:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102226560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.336825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788970306.336825:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788970306.337085:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970306.337191:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970306.337202:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102226816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970306.337238:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970306.338014:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226816 00000100:00100000:0.0:1788970306.338023:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226816 00000100:00100000:0.0:1788970306.338070:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970306.338078:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102226816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970306.338106:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970306.338146:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102226816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970306.338152:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788970306.338371:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c67480 x1875871102226816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970306.338412:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102226816:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788970306.338434:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970306.338685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102226688:0@lo:400:kworker.0 00010000:00080000:0.0:1788970306.338698:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58de1c0 x1875871102226560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970306.338709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102226560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970306.343663:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102226944:0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.343730:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970306.343806:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102227072:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.343818:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102226944 00000100:00100000:3.0:1788970306.343826:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102226944 00000100:00100000:2.0:1788970306.343833:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970306.343871:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227072 00000100:00100000:2.0:1788970306.343875:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227072 00000100:00100000:2.0:1788970306.343923:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970306.343932:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102227072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.343997:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102227072:12345-0@lo:400:kworker.0 Request processed in 65us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970306.344004:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970306.344041:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102227072:0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344081:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970306.344087:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102227200:0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344110:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.344133:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227200 00000100:00100000:2.0:1788970306.344136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788970306.344137:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227200 00000100:00100000:2.0:1788970306.344143:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102226944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.344153:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788970306.344159:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102227200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344174:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102226944:12345-0@lo:400:kworker.0 Request processed in 32us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970306.344181:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788970306.344191:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102227200:12345-0@lo:400:kworker.0 Request processed in 32us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.344196:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788970306.344206:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102226944:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.344223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102227200:0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344231:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970306.344237:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102227328:0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344263:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970306.344309:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102227456:0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344330:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.344341:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227328 00000100:00100000:3.0:1788970306.344345:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227328 00000100:00100000:2.0:1788970306.344351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227456 00000100:00100000:2.0:1788970306.344353:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227456 00000100:00100000:3.0:1788970306.344367:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788970306.344373:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3ecb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102227328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970306.344378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788970306.344403:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102227456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.344427:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3ecb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102227328:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.344433:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788970306.344666:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102227456:12345-0@lo:400:kworker.0 Request processed in 263us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970306.344672:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788970306.344689:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970306.344752:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102227968:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.344786:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.344818:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102227456:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.344828:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102227328:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.345534:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970306.345544:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102227840:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.345579:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.345615:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227840 00000100:00100000:3.0:1788970306.345620:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227840 00000100:00100000:3.0:1788970306.345659:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788970306.345666:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102227840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.345718:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102227840:12345-0@lo:400:kworker.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.345725:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788970306.345756:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef08000 x1875871102227840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970306.345766:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102227840:0@lo:400:kworker.0 00000100:00080000:3.0:1788970306.345780:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970306.345789:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.345812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.345829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102228096:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.345941:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.345962:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970306.345969:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102227712:0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.346053:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970306.346081:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227968 00000100:00100000:3.0:1788970306.346085:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227968 00000100:00100000:3.0:1788970306.346110:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227584 00000100:00100000:3.0:1788970306.346113:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227584 00000100:00100000:3.0:1788970306.346126:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228096 00000100:00100000:3.0:1788970306.346128:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228096 00000100:00100000:3.0:1788970306.346142:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788970306.346148:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102227968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.346183:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102227968:12345-0@lo:400:kworker.0 Request processed in 35us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.346189:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788970306.346201:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788970306.346214:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102227584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.346247:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102227584:12345-0@lo:400:kworker.0 Request processed in 34us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.346253:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788970306.346264:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970306.346269:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102228096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.346294:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102228096:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.346300:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970306.346319:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102227712 00000100:00100000:3.0:1788970306.346323:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102227712 00000100:00100000:3.0:1788970306.346346:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970306.346352:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970306.346406:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102227712:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970306.346412:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970306.346441:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102227968:0@lo:400:kworker.0 00000100:00080000:3.0:1788970306.346459:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970306.346463:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970306.346465:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788970306.346477:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef0a580 x1875871102227712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970306.346486:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102227712:0@lo:400:kworker.0 00010000:00080000:3.0:1788970306.346495:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef092c0 x1875871102227584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970306.346515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102227584:0@lo:400:kworker.0 00010000:00080000:3.0:1788970306.346526:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef09680 x1875871102228096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970306.346532:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102228096:0@lo:400:kworker.0 00010000:00010000:3.0:1788970306.590715:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970307.615000:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970307.870062:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102228224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970307.870127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970307.875779:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228224 00000100:00100000:1.0:1788970307.875793:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228224 00000100:00100000:1.0:1788970307.875894:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788970307.875904:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102228224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970307.875935:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970307.876017:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102228224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (5889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970307.876023:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788970307.876081:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58de580 x1875871102228224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970307.876100:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102228224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970307.881712:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102228352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970307.881782:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970307.881886:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228352 00000100:00100000:2.0:1788970307.881894:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228352 00000100:00100000:2.0:1788970307.881946:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970307.881956:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102228352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970307.881997:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970307.882058:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102228352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970307.882065:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788970307.882577:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58de580 x1875871102228352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970307.882595:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102228352:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788970308.636668:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970308.802115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802261:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802282:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970308.802370:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231424 00000100:00100000:2.0:1788970308.802554:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231680 00000100:00100000:2.0:1788970308.802561:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231680 00000100:00100000:2.0:1788970308.802630:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231552 00000100:00100000:2.0:1788970308.802632:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231552 00000100:00100000:2.0:1788970308.802645:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231808 00000100:00100000:2.0:1788970308.802647:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231808 00000100:00100000:2.0:1788970308.802664:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:2.0:1788970308.802675:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e93590b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082231680:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970308.802770:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e93590b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082231680:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 97us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970308.802778:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:2.0:1788970308.802811:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:2.0:1788970308.802818:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082231552:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970308.802845:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082231552:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970308.802850:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:2.0:1788970308.802877:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:2.0:1788970308.802884:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082231808:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970308.802910:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082231808:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970308.802916:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:2.0:1788970308.802980:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231936 00000100:00100000:2.0:1788970308.802984:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231936 00000100:00100000:2.0:1788970308.803015:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232064 00000100:00100000:2.0:1788970308.803019:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232064 00000100:00100000:2.0:1788970308.803042:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1788970308.803049:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082231936:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970308.803076:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082231936:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970308.803082:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1788970308.803094:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1788970308.803100:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082232064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970308.803126:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082232064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970308.803132:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00080000:2.0:1788970308.803167:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970308.803173:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970308.803176:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970308.803178:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970308.803728:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082231296 00000100:00100000:1.0:1788970308.803736:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231296 00000100:00100000:1.0:1788970308.803806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 301 00000100:00100000:1.0:1788970308.803815:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082231296:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970308.803870:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082231296:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 47us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970308.803877:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 301 00000100:00100000:3.0:1788970308.804575:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082231424 00000100:00080000:2.0:1788970308.804696:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970308.804741:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:3.0:1788970308.804751:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082231424:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970308.804826:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082231424:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 76us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970308.804832:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:1.0:1788970308.894238:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970308.894280:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102228480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970308.902274:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970308.905799:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228480 00000100:00100000:3.0:1788970308.905840:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228480 00000100:00100000:3.0:1788970308.905945:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788970308.905957:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102228480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970308.906009:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970308.906123:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102228480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970308.906131:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788970308.906840:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102228480:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788970309.661613:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788970309.935355:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00100000:2.0:1788970309.940307:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00100000:2.0:1788970309.940900:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00100000:0.0:1788970309.941831:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:02000400:0.0:1788970310.411153:0:12193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788970310.436143:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970310.436165:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102228608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970310.436228:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970310.436365:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228608 00000100:00100000:3.0:1788970310.436373:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228608 00000100:00100000:3.0:1788970310.436446:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788970310.436456:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102228608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970310.436493:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970310.436548:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102228608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970310.436555:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788970310.436599:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102228608:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970310.684714:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970311.452655:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970311.452676:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102228736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970311.452733:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970311.452793:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228736 00000100:00100000:2.0:1788970311.452800:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228736 00000100:00100000:2.0:1788970311.452863:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788970311.452879:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102228736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970311.452907:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970311.452945:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102228736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970311.452952:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788970311.452971:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788970311.452995:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c67480 x1875871102228736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970311.453012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102228736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970311.453238:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102228992:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453269:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453289:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102229504:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453308:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453324:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102230016:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453342:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453359:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788970311.453364:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102228864:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453421:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453450:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102229376:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453474:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453492:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102229888:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453513:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102229120:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453559:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453576:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102229632:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453595:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453612:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102230144:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453629:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453639:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788970311.453644:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102229248:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453669:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102229760:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453704:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453721:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102230272:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453739:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970311.453764:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228992 00000100:00100000:0.0:1788970311.453769:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228992 00000100:00100000:0.0:1788970311.453792:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229504 00000100:00100000:0.0:1788970311.453795:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229504 00000100:00100000:0.0:1788970311.453815:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230016 00000100:00100000:0.0:1788970311.453817:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230016 00000100:00100000:0.0:1788970311.453852:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229632 00000100:00100000:0.0:1788970311.453855:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229632 00000100:00100000:0.0:1788970311.453866:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230144 00000100:00100000:0.0:1788970311.453868:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230144 00000100:00100000:0.0:1788970311.453899:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229248 00000100:00100000:0.0:1788970311.453902:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229248 00000100:00100000:0.0:1788970311.453914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788970311.453921:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102228992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.453961:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102228992:12345-0@lo:400:kworker.0 Request processed in 41us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.453967:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788970311.453981:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788970311.453987:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102229504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454011:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102229504:12345-0@lo:400:kworker.0 Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454016:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788970311.454025:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788970311.454031:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102230016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454052:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102230016:12345-0@lo:400:kworker.0 Request processed in 22us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788970311.454068:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788970311.454074:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102229632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454100:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102229632:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454105:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788970311.454114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788970311.454119:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102230144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454144:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102230144:12345-0@lo:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454156:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788970311.454169:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788970311.454174:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102229248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454204:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102229248:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454209:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788970311.454233:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229376 00000100:00100000:0.0:1788970311.454236:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229376 00000100:00100000:0.0:1788970311.454258:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229120 00000100:00100000:0.0:1788970311.454261:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229120 00000100:00100000:0.0:1788970311.454271:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788970311.454276:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102229376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454306:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102229376:12345-0@lo:400:kworker.0 Request processed in 29us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454311:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788970311.454323:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788970311.454329:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102229120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454354:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102229120:12345-0@lo:400:kworker.0 Request processed in 25us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454359:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788970311.454376:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229888 00000100:00100000:0.0:1788970311.454407:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229888 00000100:00100000:0.0:1788970311.454433:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102229760 00000100:00100000:0.0:1788970311.454436:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102229760 00000100:00100000:0.0:1788970311.454450:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230272 00000100:00100000:0.0:1788970311.454453:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230272 00000100:00100000:0.0:1788970311.454466:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970311.454479:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102229888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454511:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102229888:12345-0@lo:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454517:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970311.454530:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970311.454535:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102229760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454561:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102229760:12345-0@lo:400:kworker.0 Request processed in 26us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454566:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970311.454576:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970311.454582:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454606:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102230272:12345-0@lo:400:kworker.0 Request processed in 25us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970311.454611:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788970311.454639:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970311.454642:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970311.454645:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970311.454646:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970311.454676:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102229248:0@lo:400:kworker.0 00010000:00080000:0.0:1788970311.454688:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826f03c0 x1875871102229760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970311.454697:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102229760:0@lo:400:kworker.0 00010000:00080000:0.0:1788970311.454704:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826f0f00 x1875871102230272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970311.454712:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102230272:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454731:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102229120:0@lo:400:kworker.0 00010000:00080000:0.0:1788970311.454740:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826f21c0 x1875871102229632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970311.454748:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102229632:0@lo:400:kworker.0 00010000:00080000:0.0:1788970311.454757:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826f3c00 x1875871102230144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970311.454765:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102230144:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454799:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102229376:0@lo:400:kworker.0 00010000:00080000:0.0:1788970311.454809:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826f1e00 x1875871102229888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970311.454817:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102229888:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454827:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102228992:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454837:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102229504:0@lo:400:kworker.0 00000100:00100000:0.0:1788970311.454858:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102230016:0@lo:400:kworker.0 00000100:00100000:1.0:1788970311.456459:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102228864 00000100:00100000:1.0:1788970311.456471:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102228864 00000100:00100000:1.0:1788970311.456526:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788970311.456535:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102228864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970311.456611:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102228864:12345-0@lo:400:kworker.0 Request processed in 77us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970311.456627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788970311.456690:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102228864:0@lo:400:kworker.0 00000100:00100000:2.0:1788970311.458313:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102230400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970311.458397:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970311.464733:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230400 00000100:00100000:3.0:1788970311.464748:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230400 00000100:00100000:3.0:1788970311.464816:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788970311.464836:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102230400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970311.464868:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970311.482527:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102230400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17692us (24136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970311.482544:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788970311.490062:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7da40 x1875871102230400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970311.497803:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102230400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788970311.708659:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970312.732659:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970312.988682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102230656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970312.988757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970312.988898:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230656 00000100:00100000:0.0:1788970312.988906:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230656 00000100:00100000:0.0:1788970312.988961:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970312.988971:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102230656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970312.988999:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970312.989046:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102230656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970312.989070:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788970312.989211:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7d2c0 x1875871102230656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970312.989230:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102230656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970312.989306:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102230528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970312.989336:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970312.989414:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230528 00000100:00100000:0.0:1788970312.989419:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230528 00000100:00100000:0.0:1788970312.989443:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788970312.989450:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102230528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788970312.989460:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970312.989490:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102230528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970312.989496:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788970312.989621:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d8b40 x1875871102230528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970312.989635:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102230528:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788970313.757400:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970313.923695:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970313.923744:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970313.923786:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970313.923834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970313.923847:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232320 00000100:00100000:1.0:1788970313.923859:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232320 00000100:00100000:3.0:1788970313.923860:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970313.923888:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970313.923916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232576 00000100:00100000:1.0:1788970313.923920:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232576 00000100:00100000:3.0:1788970313.923929:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970313.923938:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232448 00000100:00100000:1.0:1788970313.923942:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232448 00000100:00100000:3.0:1788970313.923959:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232832 00000100:00100000:1.0:1788970313.923960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232704 00000100:00100000:1.0:1788970313.923963:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232704 00000100:00100000:3.0:1788970313.923977:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232832 00000100:00100000:1.0:1788970313.923982:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:1.0:1788970313.923993:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082232320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970313.924015:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232960 00000100:00100000:3.0:1788970313.924019:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232960 00000100:00100000:3.0:1788970313.924045:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:3.0:1788970313.924054:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970313.924083:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082232320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970313.924093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:3.0:1788970313.924095:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970313.924105:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:1.0:1788970313.924115:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:3.0:1788970313.924126:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:1.0:1788970313.924127:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970313.924142:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232960:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970313.924157:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970313.924165:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:3.0:1788970313.924176:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232960:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 39us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970313.924184:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:1.0:1788970313.924193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:3.0:1788970313.924206:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082232192 00000100:00100000:3.0:1788970313.924210:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082232192 00000100:00100000:1.0:1788970313.924215:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082232448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970313.924239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 303 00000100:00100000:1.0:1788970313.924250:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082232448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 35us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970313.924251:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082232192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970313.924264:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:3.0:1788970313.924286:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082232192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970313.924291:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 144 00000100:00100000:1.0:1788970313.924301:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970313.924305:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 303 00000100:00100000:1.0:1788970313.924335:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082232704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970313.924343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 144 00000100:00080000:1.0:1788970313.924363:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970313.924367:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970313.924370:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970313.924372:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970314.020120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970314.020144:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102230784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970314.020210:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970314.020576:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230784 00000100:00100000:3.0:1788970314.020585:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230784 00000100:00100000:3.0:1788970314.020642:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788970314.020652:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102230784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970314.020687:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970314.020759:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102230784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970314.020767:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788970314.020834:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102230784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788970314.791927:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970315.549700:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102230912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970315.549793:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970315.549940:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102230912 00000100:00100000:0.0:1788970315.549951:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102230912 00000100:00100000:0.0:1788970315.550009:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788970315.550019:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102230912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970315.550055:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970315.550112:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102230912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970315.550119:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788970315.550531:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102230912:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970315.808519:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970316.572744:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102231296:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.572824:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.572879:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102231808:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.572904:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.572924:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8335a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102232320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.572942:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.572963:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788970316.572967:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102231168:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.572983:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.572996:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102231680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.573013:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.573031:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8335b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102232192:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.573049:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.573088:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231808 00000100:00100000:3.0:1788970316.573096:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231808 00000100:00100000:3.0:1788970316.573136:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232320 00000100:00100000:3.0:1788970316.573139:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232320 00000100:00100000:3.0:1788970316.573154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231168 00000100:00100000:3.0:1788970316.573156:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231168 00000100:00100000:3.0:1788970316.573165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231680 00000100:00100000:3.0:1788970316.573168:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231680 00000100:00100000:3.0:1788970316.573177:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232192 00000100:00100000:3.0:1788970316.573180:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232192 00000100:00100000:3.0:1788970316.573193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788970316.573201:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102231808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.573250:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102231808:12345-0@lo:400:kworker.0 Request processed in 49us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970316.573456:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788970316.573466:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102232320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.573502:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102232320:12345-0@lo:400:kworker.0 Request processed in 38us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970316.573508:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788970316.573527:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788970316.573534:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102231168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.573559:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102231168:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970316.573565:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788970316.573576:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788970316.573590:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102231680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.573638:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102231680:12345-0@lo:400:kworker.0 Request processed in 48us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970316.573644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788970316.573657:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788970316.573662:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102232192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.573688:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102232192:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970316.573693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788970316.573709:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970316.573713:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970316.573768:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102231168:0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.573778:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102231680:0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.573788:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8335b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102232192:0@lo:400:kworker.0 00010000:00080000:1.0:1788970316.573799:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b30c0 x1875871102231808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970316.573821:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102231808:0@lo:400:kworker.0 00010000:00080000:1.0:1788970316.573832:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8335a580 x1875871102232320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970316.573840:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8335a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102232320:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.573988:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102231424:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574021:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574052:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102231936:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574075:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574102:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102232448:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574120:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574140:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788970316.574155:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102231040:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574184:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574204:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102231552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574225:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574240:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83359e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102232064:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574269:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574284:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83592580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102232576:0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574302:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970316.574327:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231936 00000100:00100000:0.0:1788970316.574333:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231936 00000100:00100000:0.0:1788970316.574366:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232448 00000100:00100000:0.0:1788970316.574369:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232448 00000100:00100000:0.0:1788970316.574401:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232064 00000100:00100000:0.0:1788970316.574404:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232064 00000100:00100000:0.0:1788970316.574416:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232576 00000100:00100000:0.0:1788970316.574419:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232576 00000100:00100000:0.0:1788970316.574444:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788970316.574451:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102231936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574487:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102231936:12345-0@lo:400:kworker.0 Request processed in 37us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970316.574493:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788970316.574506:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970316.574512:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102232448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574537:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102232448:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970316.574542:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970316.574553:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970316.574565:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102232064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574595:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102232064:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970316.574600:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970316.574626:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970316.574632:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102232576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574655:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102232576:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970316.574660:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970316.574677:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231296 00000100:00100000:0.0:1788970316.574680:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231296 00000100:00100000:0.0:1788970316.574699:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231552 00000100:00100000:0.0:1788970316.574701:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231552 00000100:00100000:0.0:1788970316.574713:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788970316.574718:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102231296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574751:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102231296:12345-0@lo:400:kworker.0 Request processed in 32us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970316.574757:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788970316.574768:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788970316.574774:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102231552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970316.574797:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102231552:12345-0@lo:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970316.574803:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788970316.574839:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970316.574843:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970316.574862:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102231552:0@lo:400:kworker.0 00010000:00080000:0.0:1788970316.574883:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83359e00 x1875871102232064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970316.574892:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83359e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102232064:0@lo:400:kworker.0 00010000:00080000:0.0:1788970316.574902:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83592580 x1875871102232576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970316.574910:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83592580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102232576:0@lo:400:kworker.0 00010000:00080000:0.0:1788970316.574919:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836b2940 x1875871102231936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970316.574927:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102231936:0@lo:400:kworker.0 00010000:00080000:0.0:1788970316.574935:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83593480 x1875871102232448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970316.574942:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102232448:0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.575191:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788970316.575208:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231424 00000100:00100000:3.0:1788970316.575212:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231424 00000100:00100000:3.0:1788970316.575244:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788970316.575454:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102231424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970316.575501:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102231424:12345-0@lo:400:kworker.0 Request processed in 251us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970316.575507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788970316.575537:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102231424:0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.575818:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102231296:0@lo:400:kworker.0 00000100:00100000:2.0:1788970316.576000:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102231040 00000100:00100000:2.0:1788970316.576005:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102231040 00000100:00100000:2.0:1788970316.576038:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788970316.576045:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102231040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970316.576086:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102231040:12345-0@lo:400:kworker.0 Request processed in 42us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970316.576092:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788970316.576125:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102231040:0@lo:400:kworker.0 00000100:00100000:1.0:1788970316.576229:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970316.576239:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102232704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970316.576295:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970316.576328:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232704 00000100:00100000:1.0:1788970316.576332:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232704 00000100:00100000:1.0:1788970316.576357:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788970316.576363:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102232704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970316.576406:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970316.576440:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102232704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970316.576446:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788970316.576473:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e6580 x1875871102232704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970316.576486:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102232704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970316.576880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102232832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970316.576907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970316.579788:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232832 00000100:00100000:3.0:1788970316.579801:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232832 00000100:00100000:3.0:1788970316.579920:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970316.579931:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102232832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788970316.579956:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970316.580035:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102232832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (3126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970316.580055:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788970316.580133:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d81a82940 x1875871102232832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970316.580153:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102232832:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788970316.829359:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970317.856625:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970318.109262:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102232960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970318.109329:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970318.109582:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102232960 00000100:00100000:1.0:1788970318.109590:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102232960 00000100:00100000:1.0:1788970318.109643:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788970318.109653:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102232960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970318.109683:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970318.109731:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102232960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970318.109738:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788970318.109778:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e61c0 x1875871102232960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970318.109805:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102232960:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788970318.109870:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970318.110707:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970318.110720:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102233088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970318.110757:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970318.110899:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233088 00000100:00100000:0.0:1788970318.110906:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233088 00000100:00100000:0.0:1788970318.110956:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970318.110964:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102233088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970318.110980:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970318.111015:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102233088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970318.111021:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788970318.111052:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7de00 x1875871102233088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970318.111079:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102233088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788970318.111134:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788970318.876836:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970319.044013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044045:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044119:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044139:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970319.044206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233216 00000100:00100000:1.0:1788970319.044215:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233216 00000100:00100000:1.0:1788970319.044273:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233472 00000100:00100000:1.0:1788970319.044277:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233472 00000100:00100000:1.0:1788970319.044288:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233344 00000100:00100000:1.0:1788970319.044291:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233344 00000100:00100000:1.0:1788970319.044301:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233600 00000100:00100000:1.0:1788970319.044303:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233600 00000100:00100000:1.0:1788970319.044318:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 151 00000100:00100000:1.0:1788970319.044327:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082233216:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970319.044418:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082233216:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 91us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970319.044425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 151 00000100:00100000:1.0:1788970319.044951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 152 00000100:00100000:1.0:1788970319.044961:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233472:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970319.044993:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233472:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970319.044999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 152 00000100:00100000:1.0:1788970319.045011:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 153 00000100:00100000:1.0:1788970319.045034:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082233344:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970319.045061:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082233344:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970319.045134:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 153 00000100:00100000:1.0:1788970319.045148:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 154 00000100:00100000:1.0:1788970319.045155:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233600:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970319.045180:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233600:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970319.045188:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 154 00000100:00100000:1.0:1788970319.045210:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233728 00000100:00100000:1.0:1788970319.045215:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233728 00000100:00100000:1.0:1788970319.045770:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233856 00000100:00100000:1.0:1788970319.045776:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233856 00000100:00100000:1.0:1788970319.045861:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:1.0:1788970319.045868:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233728:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970319.045901:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233728:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970319.045906:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:1.0:1788970319.045918:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1788970319.045923:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233856:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970319.045946:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082233856:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970319.045951:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:0.0:1788970319.048943:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233088 00000100:00100000:0.0:1788970319.048958:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233088 00000100:00100000:0.0:1788970319.049055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 305 00000100:00100000:0.0:1788970319.049065:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082233088:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970319.049129:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082233088:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 66us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970319.049136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 305 00000100:00080000:0.0:1788970319.049180:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970319.049185:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970319.049189:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970319.049192:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970319.134968:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102233216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970319.135061:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970319.135285:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233216 00000100:00100000:0.0:1788970319.135294:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233216 00000100:00100000:0.0:1788970319.135344:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788970319.135353:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102233216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970319.135418:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788970319.135504:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102233216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970319.135510:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788970319.135830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102233216:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788970319.816067:0:12509:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970319.816327:0:12509:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970319.902470:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970320.672578:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970320.672601:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102233344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970320.672664:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970320.672722:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233344 00000100:00100000:3.0:1788970320.672730:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233344 00000100:00100000:3.0:1788970320.672774:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788970320.672795:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102233344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970320.672830:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970320.672928:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102233344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970320.672935:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788970320.675209:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102233344:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970320.926528:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970321.693559:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102233472:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693628:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.693683:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102233984:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693719:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.693747:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102234496:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693781:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.693800:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102235008:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693820:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.693847:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788970321.693853:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102233600:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693877:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.693896:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102234112:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.693901:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233984 00000100:00100000:0.0:1788970321.693914:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.693915:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233984 00000100:00100000:0.0:1788970321.693927:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102234624:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693944:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.693960:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788970321.693967:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102233728:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.693969:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102233984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.693986:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.693999:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102234240:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694016:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.694024:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102233984:12345-0@lo:400:kworker.0 Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694028:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102234752:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694031:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970321.694047:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233728 00000100:00100000:0.0:1788970321.694047:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.694050:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233728 00000100:00100000:0.0:1788970321.694058:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788970321.694063:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788970321.694063:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102233856:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694069:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102233728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694082:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.694092:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102233728:12345-0@lo:400:kworker.0 Request processed in 23us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694092:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102234368:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694097:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788970321.694109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970321.694128:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102234880:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694131:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234496 00000100:00100000:1.0:1788970321.694145:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234496 00000100:00100000:0.0:1788970321.694158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.694175:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235008 00000100:00100000:1.0:1788970321.694178:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235008 00000100:00100000:0.0:1788970321.694185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102233728:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694189:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234368 00000100:00100000:0.0:1788970321.694210:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234880 00000100:00100000:0.0:1788970321.694214:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234880 00000100:00100000:0.0:1788970321.694235:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788970321.694241:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102234496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694272:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102234496:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694279:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788970321.694290:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788970321.694294:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234368 00000100:00100000:0.0:1788970321.694296:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102235008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694313:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788970321.694318:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102234880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694321:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102235008:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694326:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788970321.694337:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788970321.694342:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102234368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.694350:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102234880:12345-0@lo:400:kworker.0 Request processed in 31us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970321.694356:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788970321.694364:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102234368:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694370:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788970321.694403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233600 00000100:00100000:0.0:1788970321.694407:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233600 00000100:00100000:0.0:1788970321.694427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234112 00000100:00100000:0.0:1788970321.694429:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234112 00000100:00100000:0.0:1788970321.694442:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234624 00000100:00100000:0.0:1788970321.694445:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234624 00000100:00100000:0.0:1788970321.694456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234240 00000100:00100000:0.0:1788970321.694458:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234240 00000100:00100000:0.0:1788970321.694480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102234752 00000100:00100000:0.0:1788970321.694483:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102234752 00000100:00100000:0.0:1788970321.694496:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233856 00000100:00100000:0.0:1788970321.694498:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233856 00000100:00100000:0.0:1788970321.694510:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788970321.694516:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102233600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694547:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102233600:12345-0@lo:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788970321.694565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788970321.694571:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102234112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694596:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102234112:12345-0@lo:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788970321.694613:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788970321.694619:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102234624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694647:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102234624:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694652:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788970321.694663:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788970321.694668:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102234240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694696:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102234240:12345-0@lo:400:kworker.0 Request processed in 28us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694701:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788970321.694713:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788970321.694719:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102234752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694755:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102234752:12345-0@lo:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694761:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788970321.694785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788970321.694791:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102233856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694818:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102233856:12345-0@lo:400:kworker.0 Request processed in 27us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970321.694823:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788970321.694855:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102233600:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694864:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102234112:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694872:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102234624:0@lo:400:kworker.0 00000100:00100000:0.0:1788970321.694879:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102233984:0@lo:400:kworker.0 00010000:00080000:0.0:1788970321.694892:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7bc00 x1875871102234496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970321.694902:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102234496:0@lo:400:kworker.0 00010000:00080000:0.0:1788970321.694911:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c78780 x1875871102235008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970321.694918:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102235008:0@lo:400:kworker.0 00000100:00080000:0.0:1788970321.694954:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970321.694957:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970321.694960:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970321.694961:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970321.694979:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102233856:0@lo:400:kworker.0 00010000:00080000:0.0:1788970321.694999:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7ad00 x1875871102234368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970321.695007:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102234368:0@lo:400:kworker.0 00010000:00080000:0.0:1788970321.695016:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c783c0 x1875871102234880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970321.695024:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102234880:0@lo:400:kworker.0 00010000:00080000:0.0:1788970321.695032:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7b840 x1875871102234240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970321.695039:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102234240:0@lo:400:kworker.0 00010000:00080000:0.0:1788970321.695048:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c79e00 x1875871102234752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970321.695056:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102234752:0@lo:400:kworker.0 00000100:00100000:3.0:1788970321.696878:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102235136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970321.696978:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970321.697364:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235136 00000100:00100000:1.0:1788970321.697373:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235136 00000100:00100000:1.0:1788970321.697453:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788970321.697462:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebc9cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102235136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970321.697510:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970321.697569:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebc9cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102235136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970321.697576:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788970321.697954:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835161c0 x1875871102235136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970321.697972:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102235136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970321.698421:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102233472 00000100:00100000:2.0:1788970321.698427:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102233472 00000100:00100000:2.0:1788970321.698464:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788970321.698472:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102233472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970321.698521:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102233472:12345-0@lo:400:kworker.0 Request processed in 50us (4892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970321.698534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788970321.698572:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102233472:0@lo:400:kworker.0 00000100:00100000:1.0:1788970321.698709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102235264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970321.698742:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970321.698833:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235264 00000100:00100000:3.0:1788970321.698837:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235264 00000100:00100000:3.0:1788970321.698871:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788970321.698878:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102235264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788970321.698891:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970321.698933:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102235264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970321.698939:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788970321.699001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835161c0 x1875871102235264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970321.699015:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102235264:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788970321.953465:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970322.059149:0:12608:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970322.061007:0:12608:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970322.972570:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970323.231040:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970323.231063:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102235392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970323.231137:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970323.231197:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235392 00000100:00100000:1.0:1788970323.231204:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235392 00000100:00100000:1.0:1788970323.231256:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788970323.231267:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102235392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970323.231295:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970323.231343:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102235392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970323.231349:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788970323.231369:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970323.231415:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c78f00 x1875871102235392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970323.231432:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102235392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970323.232946:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970323.232964:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102235520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970323.233021:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970323.233070:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235520 00000100:00100000:3.0:1788970323.233076:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235520 00000100:00100000:3.0:1788970323.233125:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788970323.233134:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102235520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970323.233156:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970323.233198:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102235520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970323.233204:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788970323.233227:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788970323.233250:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83516580 x1875871102235520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970323.233269:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102235520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788970324.000940:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970324.164209:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970324.164291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970324.164321:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970324.164340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970324.164370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970324.164413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970324.164446:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234240 00000100:00100000:1.0:1788970324.165599:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234240 00000100:00100000:1.0:1788970324.165669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234496 00000100:00100000:1.0:1788970324.165673:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234496 00000100:00100000:1.0:1788970324.165685:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234112 00000100:00100000:1.0:1788970324.165687:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234112 00000100:00100000:1.0:1788970324.165696:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234368 00000100:00100000:1.0:1788970324.165697:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234368 00000100:00100000:1.0:1788970324.165712:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1788970324.165721:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082234240:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970324.165803:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082234240:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 83us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970324.165810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1788970324.165827:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:1.0:1788970324.165833:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082234496:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970324.165857:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082234496:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970324.165862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:1.0:1788970324.165872:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:1.0:1788970324.165878:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082234112:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970324.165897:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082234112:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 20us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970324.165902:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:1.0:1788970324.165911:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:1.0:1788970324.165929:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082234368:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970324.165958:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082234368:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970324.165963:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00080000:1.0:1788970324.165995:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970324.165998:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970324.166260:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082233984 00000100:00100000:3.0:1788970324.166265:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082233984 00000100:00100000:3.0:1788970324.166306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 307 00000100:00100000:3.0:1788970324.166313:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082233984:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970324.166485:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082233984:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 172us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970324.166491:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 307 00000100:00100000:1.0:1788970324.167361:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970324.176584:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234624 00000100:00100000:2.0:1788970324.176601:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234624 00000100:00100000:3.0:1788970324.177122:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234752 00000100:00100000:3.0:1788970324.177137:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234752 00000020:00000004:0.0:1788970324.178277:0:12706:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1788970324.178303:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:3.0:1788970324.178329:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2399:x1875871082234752:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:3.0:1788970324.178372:0:10104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e97a 00000100:00080000:3.0:1788970324.178421:0:10104:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf421800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970324.178491:0:10104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000020:00000004:0.0:1788970324.178681:0:12706:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788970324.179497:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+2:2399:x1875871082234752:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 1173us (12130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970324.179510:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:2.0:1788970324.179632:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970324.183019:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970324.185902:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970324.185959:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:3.0:1788970324.185979:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2399:x1875871082234624:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:3.0:1788970324.186025:0:8441:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e973 00000100:00080000:3.0:1788970324.186040:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf425000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788970324.186097:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788970324.186105:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788970324.186624:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+2:2399:x1875871082234624:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 650us (22421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970324.186633:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1788970324.254150:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970324.254175:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102235648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970324.254358:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970324.254447:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235648 00000100:00100000:2.0:1788970324.254456:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235648 00000100:00100000:2.0:1788970324.254511:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788970324.254521:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102235648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970324.254553:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970324.254611:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102235648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970324.254618:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788970324.254675:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102235648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788970325.023196:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970325.788862:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102235776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970325.789027:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970325.789130:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235776 00000100:00100000:2.0:1788970325.789140:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235776 00000100:00100000:2.0:1788970325.789200:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788970325.789212:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102235776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970325.789269:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970325.789328:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102235776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970325.789336:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788970325.790116:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102235776:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788970326.045533:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970326.210310:0:12803:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970326.211200:0:12803:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788970326.812699:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970326.812742:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102235904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970326.812815:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.812877:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102235904 00000100:00100000:3.0:1788970326.812885:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102235904 00000100:00100000:3.0:1788970326.812935:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788970326.812944:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102235904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970326.812972:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970326.813016:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102235904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970326.813023:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788970326.813043:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788970326.813083:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83515a40 x1875871102235904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970326.813102:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102235904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970326.816122:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102236160:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816188:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.816221:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102236672:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816242:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.816267:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102237184:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816288:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.816310:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788970326.816315:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102236032:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816340:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.816360:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102236544:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816403:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.816423:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102237056:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816450:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970326.816478:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236544 00000100:00100000:3.0:1788970326.816486:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236544 00000100:00100000:3.0:1788970326.816529:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970326.816537:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102236544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.816588:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102236544:12345-0@lo:400:kworker.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970326.816595:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788970326.816940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102236416:0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.816973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970326.816994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102236928:0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970326.817030:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102237440:0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817049:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970326.817079:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788970326.817086:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102236288:0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817107:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970326.817125:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102236800:0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817143:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970326.817162:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102237312:0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817181:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970326.817202:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236160 00000100:00100000:1.0:1788970326.817206:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236160 00000100:00100000:1.0:1788970326.817228:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236672 00000100:00100000:1.0:1788970326.817231:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236672 00000100:00100000:1.0:1788970326.817250:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237184 00000100:00100000:1.0:1788970326.817253:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237184 00000100:00100000:1.0:1788970326.817262:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236416 00000100:00100000:1.0:1788970326.817264:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236416 00000100:00100000:1.0:1788970326.817273:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236800 00000100:00100000:1.0:1788970326.817275:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236800 00000100:00100000:1.0:1788970326.817286:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237312 00000100:00100000:1.0:1788970326.817288:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237312 00000100:00100000:1.0:1788970326.817299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788970326.817305:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817337:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102236160:12345-0@lo:400:kworker.0 Request processed in 32us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.817343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788970326.817353:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788970326.817359:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102236672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817403:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102236672:12345-0@lo:400:kworker.0 Request processed in 44us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.817408:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788970326.817418:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788970326.817423:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102237184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817447:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102237184:12345-0@lo:400:kworker.0 Request processed in 24us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.817461:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788970326.817474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788970326.817479:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102236416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817510:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102236416:12345-0@lo:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.817515:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788970326.817524:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788970326.817530:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102236800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817553:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102236800:12345-0@lo:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.817557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788970326.817567:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788970326.817572:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102237312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.817592:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102237312:12345-0@lo:400:kworker.0 Request processed in 21us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.817597:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788970326.818555:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237056 00000100:00100000:3.0:1788970326.818564:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237056 00000100:00100000:1.0:1788970326.818844:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236032 00000100:00100000:1.0:1788970326.818848:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236032 00000100:00100000:1.0:1788970326.820221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788970326.820238:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102236032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.820320:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102236032:12345-0@lo:400:kworker.0 Request processed in 90us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.820327:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788970326.820375:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236928 00000100:00100000:1.0:1788970326.820399:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236928 00000100:00100000:1.0:1788970326.820445:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237440 00000100:00100000:1.0:1788970326.820448:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237440 00000100:00100000:1.0:1788970326.820468:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788970326.820475:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102237056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.820509:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102237056:12345-0@lo:400:kworker.0 Request processed in 36us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.820514:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788970326.820527:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788970326.820532:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102236928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970326.820557:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102236928:12345-0@lo:400:kworker.0 Request processed in 26us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.820562:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788970326.820572:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788970326.820577:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102237440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970326.820589:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83591680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102237568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970326.820606:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102237440:12345-0@lo:400:kworker.0 Request processed in 28us (3555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.820611:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788970326.820644:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102236288 00000100:00100000:1.0:1788970326.820648:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102236288 00000100:00100000:1.0:1788970326.820674:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788970326.820681:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83359680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102236288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970326.820707:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970326.820764:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237568 00000100:00100000:0.0:1788970326.820769:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237568 00000100:00100000:0.0:1788970326.820796:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788970326.820804:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102237568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970326.820819:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970326.820870:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102237568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970326.820874:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102236032:0@lo:400:kworker.0 00000100:00100000:0.0:1788970326.820881:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788970326.820896:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102236544:0@lo:400:kworker.0 00010000:00080000:3.0:1788970326.820911:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee412c0 x1875871102237056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970326.820920:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102237056:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.820933:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102236160:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.820943:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102236672:0@lo:400:kworker.0 00000100:00100000:3.0:1788970326.820952:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102237184:0@lo:400:kworker.0 00000100:00080000:2.0:1788970326.824492:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970326.824500:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970326.824504:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970326.824507:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970326.824822:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83359680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102236288:12345-0@lo:400:kworker.0 Request processed in 4135us (7706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970326.824834:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788970326.826423:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83591680 x1875871102237568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970326.826761:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83591680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102237568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970326.829873:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102236288:0@lo:400:kworker.0 00010000:00080000:2.0:1788970326.829897:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee403c0 x1875871102236800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970326.829907:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102236800:0@lo:400:kworker.0 00010000:00080000:2.0:1788970326.829919:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee40780 x1875871102237312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970326.829927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee40780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102237312:0@lo:400:kworker.0 00000100:00100000:2.0:1788970326.829938:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102236416:0@lo:400:kworker.0 00010000:00080000:2.0:1788970326.829949:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee41e00 x1875871102236928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970326.829956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102236928:0@lo:400:kworker.0 00010000:00080000:2.0:1788970326.829966:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee40000 x1875871102237440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970326.829985:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102237440:0@lo:400:kworker.0 00010000:00010000:1.0:1788970327.068550:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970328.094610:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970328.349530:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970328.349552:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102237696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970328.349618:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970328.349714:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237696 00000100:00100000:3.0:1788970328.349730:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237696 00000100:00100000:3.0:1788970328.349794:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788970328.349804:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102237696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970328.349833:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970328.349883:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102237696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970328.349901:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788970328.349943:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee43480 x1875871102237696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970328.349960:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102237696:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788970328.350020:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970328.350191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102237824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970328.350220:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970328.350305:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237824 00000100:00100000:2.0:1788970328.350309:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237824 00000100:00100000:2.0:1788970328.350349:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788970328.350356:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102237824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970328.350366:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970328.350415:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102237824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970328.350422:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788970328.350510:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788970328.350531:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef09680 x1875871102237824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970328.350545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102237824:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788970328.409945:0:12901:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970328.410223:0:12901:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970329.116510:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970329.288495:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970329.288550:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970329.288580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970329.288602:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970329.288655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970329.288692:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235136 00000100:00100000:1.0:1788970329.288705:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235136 00000100:00100000:1.0:1788970329.288782:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235392 00000100:00100000:1.0:1788970329.288786:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235392 00000100:00100000:1.0:1788970329.288801:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235008 00000100:00100000:1.0:1788970329.288803:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235008 00000100:00100000:1.0:1788970329.288814:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235264 00000100:00100000:1.0:1788970329.288816:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235264 00000100:00100000:1.0:1788970329.288834:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 171 00000100:00100000:1.0:1788970329.288847:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082235136:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970329.288956:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082235136:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970329.288964:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 171 00000100:00100000:1.0:1788970329.288985:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 172 00000100:00100000:1.0:1788970329.288991:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082235392:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970329.289018:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082235392:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970329.289024:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 172 00000100:00100000:1.0:1788970329.289037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 173 00000100:00100000:1.0:1788970329.289043:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082235008:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970329.289070:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082235008:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970329.289076:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 173 00000100:00100000:1.0:1788970329.289096:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 174 00000100:00100000:1.0:1788970329.289102:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082235264:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970329.289128:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082235264:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970329.289134:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 174 00000100:00100000:3.0:1788970329.292554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082234880 00000100:00100000:3.0:1788970329.292581:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082234880 00000100:00100000:3.0:1788970329.292779:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 309 00000100:00100000:3.0:1788970329.292793:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082234880:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970329.292906:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082234880:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 117us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970329.292914:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 309 00000100:00080000:3.0:1788970329.292972:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970329.292982:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970329.372764:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102237952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970329.372836:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970329.372969:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102237952 00000100:00100000:1.0:1788970329.372978:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102237952 00000100:00100000:1.0:1788970329.373031:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788970329.373041:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102237952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970329.373073:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970329.373120:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102237952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970329.373127:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970329.373299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102237952:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788970329.910058:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000020:00000080:3.0:1788970329.910067:0:8435:0:(genops.c:885:class_export_put()) final put ffff8a7ebf423000/84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00100000:2.0:1788970329.910193:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000020:00000080:2.0:1788970329.910197:0:9519:0:(genops.c:885:class_export_put()) final put ffff8a7ebf422000/84179ff9-de03-4594-a7ab-22774d7b8d1d 00000020:00000080:0.0:1788970329.914180:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf423000/84179ff9-de03-4594-a7ab-22774d7b8d1d for lustre-OST0000 00000020:00000080:1.0:1788970329.915674:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf422000/84179ff9-de03-4594-a7ab-22774d7b8d1d for lustre-OST0001 00000020:00000080:1.0:1788970329.915735:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf425000 for lustre-OST0000 00000020:00000080:1.0:1788970329.915741:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf421800 for lustre-OST0001 00010000:00010000:1.0:1788970330.141492:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970330.911693:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83592940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102238080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970330.911771:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970330.912376:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238080 00000100:00100000:1.0:1788970330.912416:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238080 00000100:00100000:1.0:1788970330.912467:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788970330.912476:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102238080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970330.912510:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788970330.915211:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102238080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2726us (3430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970330.915225:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788970330.915332:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83592940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102238080:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788970331.165724:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970331.913130:0:13046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788970331.932928:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102238208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970331.932992:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.933059:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238208 00000100:00100000:2.0:1788970331.933066:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238208 00000100:00100000:2.0:1788970331.933112:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788970331.933121:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102238208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970331.933158:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970331.933198:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102238208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.933205:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788970331.933243:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef08780 x1875871102238208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970331.933260:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102238208:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788970331.936868:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970331.938773:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102238464:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.938840:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.938890:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102238976:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.938912:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.938936:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102239488:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.938954:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.938978:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788970331.938984:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102238336:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939011:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.939032:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102238848:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939055:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.939071:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102239360:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939090:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.939104:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102239872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970331.939129:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970331.939158:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238464 00000100:00100000:2.0:1788970331.939165:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238464 00000100:00100000:2.0:1788970331.939222:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238976 00000100:00100000:2.0:1788970331.939226:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238976 00000100:00100000:2.0:1788970331.939245:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239488 00000100:00100000:2.0:1788970331.939248:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239488 00000100:00100000:2.0:1788970331.939266:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788970331.939275:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102238464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939325:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102238464:12345-0@lo:400:kworker.0 Request processed in 52us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.939333:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788970331.939350:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788970331.939356:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102238976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939401:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102238976:12345-0@lo:400:kworker.0 Request processed in 45us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.939406:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788970331.939418:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788970331.939424:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102239488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939451:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102239488:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.939456:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788970331.939478:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238848 00000100:00100000:2.0:1788970331.939482:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238848 00000100:00100000:2.0:1788970331.939508:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788970331.939514:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102238848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.939544:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102238848:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.939550:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788970331.939586:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239872 00000100:00100000:3.0:1788970331.939917:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102238592:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.939949:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970331.939973:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102239104:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.939994:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970331.940011:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102239616:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940030:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970331.940046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788970331.940052:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102238720:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970331.940081:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102239232:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940098:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970331.940110:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102239744:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940125:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970331.940148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238336 00000100:00100000:3.0:1788970331.940152:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238336 00000100:00100000:3.0:1788970331.940177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788970331.940182:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102238336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940212:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102238336:12345-0@lo:400:kworker.0 Request processed in 30us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970331.940217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:3.0:1788970331.940239:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970331.940248:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238592 00000100:00100000:3.0:1788970331.940251:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238592 00000100:00100000:3.0:1788970331.940269:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788970331.940281:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102238592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940311:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102238592:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970331.940316:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788970331.940330:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239360 00000100:00100000:3.0:1788970331.940333:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239360 00000100:00100000:3.0:1788970331.940353:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239232 00000100:00100000:3.0:1788970331.940355:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239232 00000100:00100000:3.0:1788970331.940367:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239744 00000100:00100000:3.0:1788970331.940369:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239744 00000100:00100000:3.0:1788970331.940397:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788970331.940404:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102239360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940432:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102239360:12345-0@lo:400:kworker.0 Request processed in 29us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970331.940438:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788970331.940447:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788970331.940452:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102239232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940473:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102239232:12345-0@lo:400:kworker.0 Request processed in 21us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970331.940478:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788970331.940486:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788970331.940491:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102239744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940513:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102239744:12345-0@lo:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970331.940518:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1788970331.940549:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e6580 x1875871102239232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970331.940573:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102239232:0@lo:400:kworker.0 00010000:00080000:3.0:1788970331.940584:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d81a821c0 x1875871102239744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970331.940607:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102239744:0@lo:400:kworker.0 00000100:00100000:3.0:1788970331.940617:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102238592:0@lo:400:kworker.0 00000100:00080000:3.0:1788970331.940640:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970331.940642:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970331.940655:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239104 00000100:00100000:3.0:1788970331.940658:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239104 00000100:00100000:3.0:1788970331.940676:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102239616 00000100:00100000:3.0:1788970331.940679:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239616 00000100:00100000:3.0:1788970331.940688:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102238720 00000100:00100000:3.0:1788970331.940690:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102238720 00000100:00100000:3.0:1788970331.940713:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788970331.940719:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102239104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.940875:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102239872 00000100:00100000:2.0:1788970331.940903:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970331.940908:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102239872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970331.940922:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970331.940954:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102239872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.940959:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970331.940992:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102238336:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.941004:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102238848:0@lo:400:kworker.0 00010000:00080000:2.0:1788970331.941015:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d81a83480 x1875871102239360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970331.941023:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102239360:0@lo:400:kworker.0 00010000:00080000:2.0:1788970331.941033:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef08780 x1875871102239872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970331.941045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102239872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970331.941056:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102238464:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.941068:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102238976:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.941077:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102239488:0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.941180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788970331.941188:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102239616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.941220:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102239616:12345-0@lo:400:kworker.0 Request processed in 34us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.941236:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788970331.941248:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788970331.941253:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970331.941278:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102238720:12345-0@lo:400:kworker.0 Request processed in 25us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970331.941283:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788970331.944083:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102239104:12345-0@lo:400:kworker.0 Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970331.944098:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1788970331.944140:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970331.944182:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102238720:0@lo:400:kworker.0 00010000:00080000:3.0:1788970331.944197:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d836e4f00 x1875871102239104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970331.944206:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102239104:0@lo:400:kworker.0 00010000:00080000:3.0:1788970331.944217:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d81a80000 x1875871102239616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970331.944236:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102239616:0@lo:400:kworker.0 00010000:00010000:1.0:1788970332.188824:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970333.213163:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970333.471864:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102240000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970333.471932:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970333.472002:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240000 00000100:00100000:1.0:1788970333.472010:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240000 00000100:00100000:1.0:1788970333.472062:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788970333.472072:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102240000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970333.472099:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970333.472142:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102240000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970333.472150:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788970333.472188:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d81a83c00 x1875871102240000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970333.472207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102240000:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788970333.472471:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970333.472479:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970333.472489:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102240128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970333.472520:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970333.472555:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240128 00000100:00100000:3.0:1788970333.472559:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240128 00000100:00100000:3.0:1788970333.472811:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788970333.472820:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102240128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970333.472833:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970333.472880:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102240128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970333.472887:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788970333.472904:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970333.473621:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83515e00 x1875871102240128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970333.473639:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102240128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788970334.237670:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970334.403049:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970334.403101:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970334.403134:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970334.403159:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235520 00000100:00100000:1.0:1788970334.403175:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235520 00000100:00100000:3.0:1788970334.403177:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970334.403214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970334.403246:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235776 00000100:00100000:3.0:1788970334.403255:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235776 00000100:00100000:3.0:1788970334.403317:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236032 00000100:00100000:3.0:1788970334.403320:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236032 00000100:00100000:3.0:1788970334.403333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235648 00000100:00100000:3.0:1788970334.403336:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235648 00000100:00100000:3.0:1788970334.403347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082235904 00000100:00100000:3.0:1788970334.403350:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082235904 00000100:00100000:3.0:1788970334.403434:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:3.0:1788970334.403448:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082235776:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970334.403543:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082235776:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 98us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970334.403551:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:3.0:1788970334.403571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:3.0:1788970334.403587:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082236032:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970334.403611:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082236032:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970334.403616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:3.0:1788970334.403628:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:3.0:1788970334.403634:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082235648:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970334.403650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 311 00000100:00100000:3.0:1788970334.403665:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082235648:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970334.403673:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2403:x1875871082235520:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970334.403690:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:3.0:1788970334.403708:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:1.0:1788970334.403847:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2403:x1875871082235520:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 183us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970334.403857:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 311 00000100:00100000:3.0:1788970334.404010:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082235904:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970334.404051:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082235904:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 335us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970334.404058:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00080000:3.0:1788970334.404088:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970334.404092:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970334.492602:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970334.492626:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102240256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970334.492743:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970334.492827:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240256 00000100:00100000:2.0:1788970334.492836:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240256 00000100:00100000:2.0:1788970334.492897:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788970334.492909:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102240256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970334.492947:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970334.492998:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102240256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970334.493006:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788970334.493060:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102240256:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788970335.172665:0:13194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff92abbf30 20000000:00000080:3.0:1788970335.172824:0:13194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7ebf3ca000 uarg=0000000000000000 20000000:01000000:3.0:1788970335.172874:0:13194:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788970335.172880:0:13194:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788970335.172885:0:13194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788970335.173956:0:13195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788970335.174142:0:13194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788970335.182237:0:13194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788970335.182271:0:13194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182294:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182303:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182311:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182317:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182323:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182330:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182336:0:13194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182711:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182744:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 12 pid: 6516 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.182759:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240384:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970335.182925:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.182934:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 23 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.182944:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240512:0@lo:104: 00000100:00100000:3.0:1788970335.182983:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970335.183027:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183035:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 23 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.183043:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240640:0@lo:104: 00000100:00100000:3.0:1788970335.183063:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970335.183093:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240512 00000100:00100000:3.0:1788970335.183100:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240512 00000100:00100000:3.0:1788970335.183141:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240640 00000100:00100000:3.0:1788970335.183144:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240640 00000100:00100000:3.0:1788970335.183158:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970335.183166:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:13194:x1875871102240512:12345-0@lo:104: 00010000:00010000:3.0:1788970335.183178:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183231:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970335.183237:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:13194:x1875871102240512:12345-0@lo:104: Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970335.183244:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970335.183261:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970335.183268:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13194:x1875871102240640:12345-0@lo:104: 00010000:00010000:3.0:1788970335.183275:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183307:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788970335.183313:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13194:x1875871102240640:12345-0@lo:104: Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970335.183319:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788970335.183346:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183354:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 23 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.183362:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240768:0@lo:104: 00000100:00100000:3.0:1788970335.183415:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970335.183448:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240768 00000100:00100000:3.0:1788970335.183452:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240768 00000100:00100000:3.0:1788970335.183469:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788970335.183475:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13194:x1875871102240768:12345-0@lo:104: 00010000:00010000:3.0:1788970335.183482:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183521:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788970335.183526:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13194:x1875871102240768:12345-0@lo:104: Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970335.183532:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1788970335.183563:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183571:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 23 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.183579:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240896:0@lo:104: 00000100:00100000:3.0:1788970335.183601:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970335.183620:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102240896 00000100:00100000:3.0:1788970335.183623:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102240896 00000100:00100000:3.0:1788970335.183640:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970335.183645:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13194:x1875871102240896:12345-0@lo:104: 00010000:00010000:3.0:1788970335.183652:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183691:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788970335.183696:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13194:x1875871102240896:12345-0@lo:104: Request processed in 52us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970335.183702:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788970335.183728:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.183737:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 12 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.183758:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102241024:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970335.183785:0:13194:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970335.183804:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240512:0@lo:104: 00000100:00100000:3.0:1788970335.183813:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240640:0@lo:104: 00000100:00100000:3.0:1788970335.183818:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240768:0@lo:104: 00000100:00100000:3.0:1788970335.183824:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240896:0@lo:104: 00010000:00010000:2.0:1788970335.184242:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788970335.184250:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184258:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970335.184262:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184283:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970335.184290:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970335.184297:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970335.184336:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184343:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970335.184374:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184402:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c6e942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e949 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184416:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788970335.184419:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184424:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970335.184427:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184443:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970335.184450:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970335.184461:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970335.184477:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184482:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970335.184489:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184496:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6e934 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e93b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184506:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970335.184509:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184514:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970335.184517:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184524:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970335.184531:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970335.184536:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970335.184549:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184554:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970335.184813:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184820:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6e926 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e92d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184830:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970335.184834:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184839:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9bc00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970335.184842:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184848:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970335.184853:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970335.184859:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970335.184873:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184878:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970335.184884:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184890:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9bc00/0xc3abfebe76c6e918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e91f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.184902:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970335.184909:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970335.184911:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970335.184926:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102241408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970335.184967:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970335.184997:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970335.185003:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102241536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970335.185023:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970335.185056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241408 00000100:00100000:2.0:1788970335.185061:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241408 00010000:00010000:2.0:1788970335.185083:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 24 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970335.185107:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241536 00000100:00100000:2.0:1788970335.185110:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241536 00010000:00010000:2.0:1788970335.185123:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 25 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970335.185143:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788970335.185150:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+25:3651:x1875871102241408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970335.185160:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970335.185166:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 25 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.185175:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 25 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.185188:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6e92d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e926 expref: 25 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.185201:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970335.185239:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102241408:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970335.185246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788970335.185263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970335.185268:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3651:x1875871102241536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970335.185276:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970335.185280:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 23 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.185288:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 23 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.185298:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6e91f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e918 expref: 23 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.185306:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970335.185327:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3651:x1875871102241536:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970335.185333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970335.185372:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102241536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970335.185401:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102241408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970335.185491:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102241152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970335.185522:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970335.185550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970335.185555:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102241280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970335.185586:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970335.185893:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241152 00000100:00100000:2.0:1788970335.185898:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241152 00010000:00010000:2.0:1788970335.185914:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 22 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970335.185938:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241280 00000100:00100000:2.0:1788970335.185942:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241280 00010000:00010000:2.0:1788970335.185953:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 23 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970335.185980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970335.185986:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3649:x1875871102241152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970335.185995:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970335.185999:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 23 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.186007:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 23 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.186016:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6e949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e942 expref: 23 pid: 6516 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.186025:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970335.186055:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3649:x1875871102241152:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970335.186061:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970335.186074:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970335.186080:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3649:x1875871102241280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970335.186087:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970335.186091:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 21 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.186099:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 21 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.186108:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c6e93b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e934 expref: 21 pid: 6517 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.186126:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970335.186146:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:3649:x1875871102241280:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970335.186151:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970335.186177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102241280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970335.186184:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102241152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970335.186715:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970335.191124:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970335.191216:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102240384:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970335.191229:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1875871102241024:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970335.191262:0:13194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.191420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970335.195175:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236160 00000100:00100000:2.0:1788970335.195191:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236160 00010000:00010000:3.0:1788970335.195332:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 13 pid: 6516 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.195367:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236288 00000100:00100000:3.0:1788970335.195375:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236288 00010000:00010000:3.0:1788970335.195427:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 14 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970335.195451:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1788970335.195461:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82549e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+14:2402:x1875871082236160:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970335.195475:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970335.195482:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 14 pid: 6516 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195493:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 14 pid: 6516 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195510:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654800/0xc3abfebe76c6e95e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6cc expref: 14 pid: 6516 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195537:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970335.195601:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82549e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082236160:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 141us (4485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970335.195609:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1788970335.195782:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:3.0:1788970335.195799:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:2403:x1875871082236288:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970335.195811:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970335.195816:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 12 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195827:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 12 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195848:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c6e911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d68d expref: 12 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195860:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195869:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195945:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195952:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195968:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195975:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195981:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970335.195985:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.195993:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.196007:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970335.196017:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970335.196042:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:2403:x1875871082236288:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 252us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970335.196049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00010000:00010000:0.0:1788970335.196190:0:13194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970335.196202:0:13194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970335.196209:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4c00/0xc3abfebe76c6e981 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970335.260496:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970336.035167:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102241664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970336.035243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970336.035321:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241664 00000100:00100000:3.0:1788970336.035331:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241664 00000100:00100000:3.0:1788970336.035404:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788970336.035415:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102241664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970336.035449:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970336.035504:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102241664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.035511:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788970336.036599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102241664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788970336.285413:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970336.777962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970336.778054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236416 00000100:00100000:0.0:1788970336.778064:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236416 00000100:00100000:0.0:1788970336.778118:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 312 00000100:00100000:0.0:1788970336.778127:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:6174:x1875871082236416:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970336.778144:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970336.778163:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d6fd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.778192:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.778203:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.778212:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013400, rc 0) 00000100:00100000:0.0:1788970336.778268:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082236416:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970336.778275:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 312 00000100:00100000:2.0:1788970336.785551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970336.788427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236544 00000100:00100000:3.0:1788970336.788442:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236544 00000100:00100000:3.0:1788970336.788561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 313 00000100:00100000:3.0:1788970336.788573:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082236544:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.788747:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082236544:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 175us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.788756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 313 00000100:00100000:0.0:1788970336.795888:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970336.795964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236672 00000100:00100000:3.0:1788970336.795973:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236672 00000100:00100000:3.0:1788970336.796056:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 314 00000100:00100000:3.0:1788970336.796067:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082236672:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.796203:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082236672:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 137us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.796210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 314 00000100:00100000:0.0:1788970336.818739:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970336.818871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236800 00000100:00100000:3.0:1788970336.818882:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236800 00000100:00100000:3.0:1788970336.818963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 315 00000100:00100000:3.0:1788970336.818974:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082236800:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970336.818990:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970336.819005:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d704 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.819034:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.819045:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.819061:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5800, rc 0) 00000100:00100000:3.0:1788970336.819121:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082236800:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 149us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.819128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 315 00000100:00100000:1.0:1788970336.830997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970336.831129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082236928 00000100:00100000:3.0:1788970336.831149:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082236928 00000100:00100000:3.0:1788970336.831210:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 316 00000100:00100000:3.0:1788970336.831229:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082236928:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.831406:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082236928:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 187us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.831415:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 316 00000100:00100000:1.0:1788970336.834867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970336.835912:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237056 00000100:00100000:3.0:1788970336.835924:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237056 00000100:00100000:3.0:1788970336.835994:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 317 00000100:00100000:3.0:1788970336.836005:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082237056:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.836299:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082237056:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 295us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.836308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 317 10000000:01000000:3.0:1788970336.860462:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970336.860472:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81ace000 from 7 10000000:01000000:3.0:1788970336.860478:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970336.860531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.860545:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.860564:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970336.860595:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102241792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.860682:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970336.860745:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970336.861554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241792 00000100:00100000:0.0:1788970336.861576:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241792 00000100:00100000:0.0:1788970336.861636:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788970336.861645:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102241792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970336.861673:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970336.861695:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e996 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.861722:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.861742:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.861751:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012a00, rc 0) 00000100:00100000:0.0:1788970336.861808:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102241792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970336.861815:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788970336.862080:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102241792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970336.862096:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.862106:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970336.862174:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102241920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.862204:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970336.862242:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970336.864721:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102241920 00000100:00100000:0.0:1788970336.864748:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102241920 00000100:00100000:0.0:1788970336.864805:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788970336.864815:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102241920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970336.865021:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102241920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970336.865029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788970336.865211:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102241920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.865273:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.865318:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970336.865357:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970336.865420:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242048 00000100:00100000:1.0:1788970336.865425:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242048 00000100:00100000:1.0:1788970336.865463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788970336.865471:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102242048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.865563:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102242048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970336.865570:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788970336.865654:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788970336.868718:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788970336.875129:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788970336.875173:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970336.875184:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.875198:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970336.875208:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970336.875211:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eaed7c000 from 7 10000000:01000000:1.0:1788970336.875214:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970336.875841:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.875851:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.875862:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970336.875897:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.876037:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.876111:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970336.886956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242176 00000100:00100000:3.0:1788970336.886972:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242176 00000100:00100000:3.0:1788970336.887058:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788970336.887069:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102242176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970336.887084:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970336.887102:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e9a4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.887130:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.887142:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.887152:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5e00, rc 0) 00000100:00100000:3.0:1788970336.887480:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102242176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 411us (11441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.887487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788970336.890794:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970336.890824:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.890838:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970336.890919:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.890974:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.891011:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970336.893749:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242304 00000100:00100000:0.0:1788970336.893764:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242304 00000100:00100000:0.0:1788970336.893830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788970336.893841:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102242304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970336.894006:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102242304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970336.894014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788970336.894071:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.894121:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.894180:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.894222:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970336.894269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242432 00000100:00100000:3.0:1788970336.894274:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242432 00000100:00100000:3.0:1788970336.894306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788970336.894314:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102242432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970336.894416:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102242432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970336.894423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788970336.894432:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970336.897495:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788970336.897711:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788970336.897735:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970336.897746:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.897758:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970336.897770:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970336.897772:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebb899800 from 7 10000000:01000000:0.0:1788970336.897775:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970336.897812:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.897820:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970336.897829:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970336.897855:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970336.897917:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970336.897965:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d824109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970336.898029:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242560 00000100:00100000:1.0:1788970336.898036:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242560 00000100:00100000:1.0:1788970336.898087:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788970336.898096:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102242560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970336.898108:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970336.898120:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e9b2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.898153:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.898163:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.898170:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655000, rc 0) 00000100:00100000:1.0:1788970336.898209:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102242560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970336.898215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788970336.898495:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970336.898509:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.898519:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970336.898575:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.898602:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.898625:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970336.898939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242688 00000100:00100000:0.0:1788970336.898944:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242688 00000100:00100000:0.0:1788970336.898979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788970336.898986:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102242688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970336.899085:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102242688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970336.899103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788970336.899179:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.899206:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.899245:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.899275:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653000 going to sleep for 11 seconds 00000100:00100000:1.0:1788970336.899286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242816 00000100:00100000:1.0:1788970336.899295:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242816 00000100:00100000:1.0:1788970336.899313:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788970336.899319:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102242816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.899415:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102242816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970336.899422:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788970336.899460:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970336.900121:0:13252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788970336.900177:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788970336.900193:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970336.900201:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900211:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970336.900220:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970336.900222:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0d2c000 from 7 10000000:01000000:1.0:1788970336.900225:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970336.900249:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900257:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900266:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970336.900282:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.900323:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.900339:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970336.900354:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102242944 00000100:00100000:1.0:1788970336.900357:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102242944 00000100:00100000:1.0:1788970336.900377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788970336.900406:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102242944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970336.900415:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970336.900425:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6e9c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900446:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900455:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900463:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:1.0:1788970336.900490:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102242944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970336.900497:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788970336.900526:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102242944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970336.900536:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970336.900544:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970336.900584:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102243072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.900615:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.900627:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970336.900637:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243072 00000100:00100000:1.0:1788970336.900640:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243072 00000100:00100000:1.0:1788970336.900655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788970336.900670:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102243072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.900750:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102243072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970336.900755:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788970336.900778:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102243072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.900798:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102243200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.900829:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970336.900840:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970336.900850:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243200 00000100:00100000:1.0:1788970336.900853:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243200 00000100:00100000:1.0:1788970336.900867:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788970336.900872:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102243200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970336.900937:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102243200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970336.900943:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788970336.900976:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102243200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970336.901692:0:13253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788970336.902019:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788970336.902040:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970336.902050:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970336.902060:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970337.053521:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102243328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970337.053614:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.053614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102243456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970337.053944:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788970337.054069:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243328 00000100:00100000:3.0:1788970337.054078:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243328 00000100:00100000:3.0:1788970337.054134:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788970337.054145:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102243328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970337.054172:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970337.056560:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.056644:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.056691:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.056723:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83592940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102244480:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.056747:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.056778:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788970337.056787:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.056812:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.056832:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82549680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102244096:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.056853:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.056870:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102244608:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.056890:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.056928:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243968 00000100:00100000:0.0:1788970337.056935:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243968 00000100:00100000:0.0:1788970337.056977:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788970337.056985:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.058075:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102243968:12345-0@lo:400:kworker.0 Request processed in 1086us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.058085:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788970337.058122:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244480 00000100:00100000:0.0:1788970337.058128:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244480 00000100:00100000:0.0:1788970337.058163:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788970337.058169:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102244480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.058860:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102244480:12345-0@lo:400:kworker.0 Request processed in 689us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.058867:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788970337.058894:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243584 00000100:00100000:0.0:1788970337.058898:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243584 00000100:00100000:0.0:1788970337.058925:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244096 00000100:00100000:0.0:1788970337.058927:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244096 00000100:00100000:0.0:1788970337.058942:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244608 00000100:00100000:0.0:1788970337.058944:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244608 00000100:00100000:0.0:1788970337.058962:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788970337.058979:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102243584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970337.059007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.059024:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102243584:12345-0@lo:400:kworker.0 Request processed in 54us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.059031:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788970337.059045:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788970337.059052:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102244096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970337.059055:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102244224:0@lo:400:kworker.0 00000100:00100000:3.0:1788970337.059081:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102243328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4937us (5468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970337.059092:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788970337.059099:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102244096:12345-0@lo:400:kworker.0 Request processed in 46us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970337.059103:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970337.059112:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788970337.059114:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243456 00000100:00100000:3.0:1788970337.059119:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243456 00000100:00100000:2.0:1788970337.059124:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102244736:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.059129:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244224 00000100:00100000:0.0:1788970337.059135:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244224 00000100:00100000:3.0:1788970337.059149:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788970337.059157:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970337.059162:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102243456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970337.059162:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244736 00000100:00100000:0.0:1788970337.059166:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244736 00000100:00100000:2.0:1788970337.059176:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00002000:00000024:3.0:1788970337.059183:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970337.059187:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8254ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102243840:0@lo:400:kworker.0 00000100:00100000:2.0:1788970337.059222:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970337.059238:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102243456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970337.059245:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788970337.059263:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83591680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102244352:0@lo:400:kworker.0 00000100:00080000:3.0:1788970337.059265:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970337.059271:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970337.059274:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970337.059277:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970337.059290:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788970337.059314:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826d9a40 x1875871102243328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970337.059315:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102244864:0@lo:400:kworker.0 00000100:00100000:3.0:1788970337.059338:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102243328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970337.059341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970337.059369:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244352 00000100:00100000:3.0:1788970337.059374:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244352 00000100:00100000:2.0:1788970337.059378:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243712 00000100:00100000:2.0:1788970337.059398:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243712 00000100:00100000:2.0:1788970337.059430:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788970337.059433:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244864 00000100:00100000:2.0:1788970337.059438:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102243712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970337.059446:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244864 00000100:00100000:3.0:1788970337.059476:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970337.059484:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102243712:12345-0@lo:400:kworker.0 Request processed in 47us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970337.059486:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102244352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970337.059498:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788970337.059523:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788970337.059536:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102244864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970337.059537:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102244352:12345-0@lo:400:kworker.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970337.059546:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788970337.059564:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970337.059720:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788970337.059731:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102244608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970337.059970:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102244864:12345-0@lo:400:kworker.0 Request processed in 440us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970337.059977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788970337.060077:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83591680 x1875871102244352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970337.060087:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83591680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102244352:0@lo:400:kworker.0 00010000:00080000:2.0:1788970337.060095:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338a940 x1875871102244864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970337.060102:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102244864:0@lo:400:kworker.0 00000100:00100000:2.0:1788970337.060111:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102243712:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.062499:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102244608:12345-0@lo:400:kworker.0 Request processed in 2764us (5602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.062530:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788970337.062561:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102243840 00000100:00100000:0.0:1788970337.062569:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102243840 00000100:00100000:0.0:1788970337.062965:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788970337.063045:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102244224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.063107:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102244224:12345-0@lo:400:kworker.0 Request processed in 66us (4006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.063113:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788970337.063128:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788970337.063134:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102244736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.063163:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102244736:12345-0@lo:400:kworker.0 Request processed in 30us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.063168:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788970337.063180:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788970337.063186:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102243840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.063279:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102243840:12345-0@lo:400:kworker.0 Request processed in 94us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970337.063285:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788970337.063358:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.063370:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82549680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102244096:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.063401:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102244608:0@lo:400:kworker.0 00000100:00100000:0.0:1788970337.063414:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102243968:0@lo:400:kworker.0 00010000:00080000:0.0:1788970337.063436:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83592940 x1875871102244480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970337.063463:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83592940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102244480:0@lo:400:kworker.0 00010000:00080000:0.0:1788970337.063479:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaee412c0 x1875871102243456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970337.063495:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaee412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102243456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970337.065605:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102243840:0@lo:400:kworker.0 00010000:00080000:2.0:1788970337.065635:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8254bc00 x1875871102244224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970337.065646:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8254bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102244224:0@lo:400:kworker.0 00010000:00080000:2.0:1788970337.065657:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338b0c0 x1875871102244736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970337.065675:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102244736:0@lo:400:kworker.0 00010000:00010000:3.0:1788970337.310422:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970338.336189:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970338.591738:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102244992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970338.591817:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970338.592042:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102245120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970338.592069:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970338.595106:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102244992 00000100:00100000:1.0:1788970338.595120:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102244992 00000100:00100000:1.0:1788970338.595181:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245120 00000100:00100000:1.0:1788970338.595185:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245120 00000100:00100000:1.0:1788970338.595201:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970338.595209:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102244992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970338.595242:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970338.595314:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102244992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (3497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970338.595320:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970338.595336:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788970338.595341:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102245120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970338.595349:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970338.602860:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102245120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7509us (10780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970338.602875:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788970338.603821:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83389a40 x1875871102245120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970338.603848:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102245120:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788970338.603903:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d81a821c0 x1875871102244992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970338.603917:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d81a821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102244992:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788970339.028619:0:13392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788970339.356681:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970339.524249:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970339.524368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970339.524465:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970339.524486:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970339.524509:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970339.525442:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237440 00000100:00100000:2.0:1788970339.525449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237184 00000100:00100000:2.0:1788970339.525458:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237184 00000100:00100000:0.0:1788970339.525458:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237440 00000100:00100000:3.0:1788970339.525578:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237312 00000100:00100000:0.0:1788970339.525580:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237568 00000100:00100000:3.0:1788970339.525585:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237312 00000100:00100000:0.0:1788970339.525587:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237568 00000100:00100000:2.0:1788970339.525592:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 330 00000100:00100000:2.0:1788970339.525605:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082237184:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970339.525705:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082237184:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 103us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970339.525713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 330 00000100:00100000:2.0:1788970339.525908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237696 00000100:00100000:2.0:1788970339.525913:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237696 00000100:00080000:1.0:1788970339.526141:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970339.526147:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970339.526208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:2.0:1788970339.526216:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082237440:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970339.526253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:2.0:1788970339.526266:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082237440:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 48us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970339.526267:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082237696:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970339.526281:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:1.0:1788970339.526310:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082237696:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 48us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970339.526318:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00080000:1.0:1788970339.526354:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970339.526810:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:0.0:1788970339.526819:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082237568:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970339.526843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:3.0:1788970339.526855:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d81a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082237312:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970339.526864:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082237568:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 45us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970339.526880:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:3.0:1788970339.526894:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d81a83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082237312:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 41us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970339.526903:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:3.0:1788970339.613468:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970339.613502:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102245248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970339.613616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970339.613908:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245248 00000100:00100000:2.0:1788970339.614063:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245248 00000100:00100000:2.0:1788970339.614138:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788970339.614149:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102245248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970339.614215:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970339.614288:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102245248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970339.614295:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788970339.614827:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102245248:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788970340.382153:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970341.148881:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970341.148904:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102245376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970341.148968:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970341.149173:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245376 00000100:00100000:0.0:1788970341.149181:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245376 00000100:00100000:0.0:1788970341.149232:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788970341.149242:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102245376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970341.149275:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970341.149331:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102245376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970341.149338:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788970341.149454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102245376:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970341.405759:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970342.172800:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102245504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970342.172893:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970342.172992:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245504 00000100:00100000:2.0:1788970342.173001:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245504 00000100:00100000:2.0:1788970342.173067:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788970342.173079:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102245504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970342.173116:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970342.173167:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102245504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970342.173175:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788970342.173358:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788970342.173418:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276e940 x1875871102245504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970342.173440:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102245504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970342.182066:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102245632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970342.182160:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970342.182693:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245632 00000100:00100000:3.0:1788970342.182705:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245632 00000100:00100000:3.0:1788970342.183358:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970342.183370:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102245632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970342.183429:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788970342.183560:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970342.184057:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102245632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 689us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970342.184076:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970342.184114:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102245888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.184158:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970342.184200:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970342.184206:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102245760:0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.184255:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970342.184298:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245888 00000100:00100000:3.0:1788970342.184305:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245888 00000100:00100000:3.0:1788970342.184343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788970342.184350:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102245888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.184407:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102245888:12345-0@lo:400:kworker.0 Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970342.184414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788970342.184435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102245760 00000100:00100000:3.0:1788970342.184439:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102245760 00000100:00100000:3.0:1788970342.184482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788970342.184493:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102245760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.184541:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102245760:12345-0@lo:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970342.184549:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788970342.184602:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102245760:0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.184641:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102245888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.186012:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102246016:0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.186071:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970342.186136:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246016 00000100:00100000:3.0:1788970342.186143:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246016 00000100:00100000:3.0:1788970342.186184:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788970342.186191:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102246016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.186254:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102246016:12345-0@lo:400:kworker.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970342.186261:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788970342.186300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102246016:0@lo:400:kworker.0 00000100:00100000:1.0:1788970342.191465:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102246272:0@lo:400:kworker.0 00000100:00100000:1.0:1788970342.191567:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970342.191630:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102246784:0@lo:400:kworker.0 00000100:00100000:1.0:1788970342.191661:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970342.191693:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788970342.191700:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102246400:0@lo:400:kworker.0 00000100:00100000:1.0:1788970342.191751:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970342.191777:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102246912:0@lo:400:kworker.0 00000100:00100000:1.0:1788970342.191804:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970342.193822:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246784 00000100:00100000:0.0:1788970342.193842:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246784 00000100:00100000:0.0:1788970342.194110:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788970342.194124:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102246784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194292:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102246784:12345-0@lo:400:kworker.0 Request processed in 171us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970342.194300:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788970342.194339:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102246528:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194405:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970342.194436:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102247040:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194454:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970342.194471:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788970342.194476:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb595bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102246144:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194490:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970342.194496:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102246656:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194510:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970342.194547:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246400 00000100:00100000:0.0:1788970342.194551:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246400 00000100:00100000:0.0:1788970342.194575:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246912 00000100:00100000:0.0:1788970342.194579:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246912 00000100:00100000:0.0:1788970342.194591:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246528 00000100:00100000:0.0:1788970342.194594:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246528 00000100:00100000:0.0:1788970342.194607:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247040 00000100:00100000:0.0:1788970342.194609:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247040 00000100:00100000:0.0:1788970342.194620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246144 00000100:00100000:0.0:1788970342.194632:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246144 00000100:00100000:0.0:1788970342.194648:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788970342.194655:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb59583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102246400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194691:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb59583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102246400:12345-0@lo:400:kworker.0 Request processed in 37us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970342.194697:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788970342.194707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788970342.194712:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102246912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194731:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102246912:12345-0@lo:400:kworker.0 Request processed in 20us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970342.194735:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788970342.194741:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788970342.194744:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102246528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194762:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102246528:12345-0@lo:400:kworker.0 Request processed in 18us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970342.194766:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788970342.194772:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788970342.194775:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102247040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194793:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102247040:12345-0@lo:400:kworker.0 Request processed in 18us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970342.194803:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788970342.194812:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788970342.194815:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102246144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.194856:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102246144:12345-0@lo:400:kworker.0 Request processed in 39us (364us total) trans 0 rc 0/0 00010000:00080000:2.0:1788970342.194866:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83389680 x1875871102245632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970342.194905:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102245632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970342.194930:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246656 00000100:00100000:3.0:1788970342.194936:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246656 00000100:00100000:3.0:1788970342.194972:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970342.194980:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102246656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.195004:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788970342.195034:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102246656:12345-0@lo:400:kworker.0 Request processed in 54us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970342.195039:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102246144:0@lo:400:kworker.0 00000100:00100000:3.0:1788970342.195045:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788970342.195054:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5958780 x1875871102246656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970342.195065:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102246656:0@lo:400:kworker.0 00010000:00080000:0.0:1788970342.195077:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb595a580 x1875871102246528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970342.195086:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102246528:0@lo:400:kworker.0 00010000:00080000:0.0:1788970342.195097:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb59592c0 x1875871102247040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970342.195106:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb59592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102247040:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.195147:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb595b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102246400:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.195154:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5958b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102246912:0@lo:400:kworker.0 00010000:00080000:0.0:1788970342.195163:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5959a40 x1875871102246784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970342.195169:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5959a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102246784:0@lo:400:kworker.0 00000100:00080000:0.0:1788970342.195196:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970342.195199:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970342.195201:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970342.196287:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102246272 00000100:00100000:1.0:1788970342.196299:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102246272 00000100:00100000:0.0:1788970342.196449:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788970342.196462:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102246272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.196548:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102246272:12345-0@lo:400:kworker.0 Request processed in 90us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970342.196590:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102246272:0@lo:400:kworker.0 00000100:00100000:0.0:1788970342.197160:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:0.0:1788970342.428562:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970343.457497:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970343.717676:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102247296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970343.717755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970343.718263:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102247168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970343.718295:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970343.719176:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247296 00000100:00100000:2.0:1788970343.719187:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247296 00000100:00100000:2.0:1788970343.719224:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247168 00000100:00100000:2.0:1788970343.719227:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247168 00000100:00100000:2.0:1788970343.719253:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788970343.719262:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5959a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102247296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970343.719295:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970343.719356:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5959a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102247296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970343.719362:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788970343.719378:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788970343.719400:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102247168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970343.719409:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970343.719440:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102247168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970343.719445:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788970343.719481:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb5959e00 x1875871102247168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970343.719500:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102247168:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788970343.719532:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83388f00 x1875871102247296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970343.719543:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102247296:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788970344.150078:0:13541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:12:22 (1788970342) === 00000100:00100000:2.0:1788970344.280111:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970344.280156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.280162:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237824 00000100:00100000:3.0:1788970344.280174:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237824 00000100:00100000:3.0:1788970344.280257:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:3.0:1788970344.280271:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082237824:12345-192.168.203.15@tcp:41:mkdir.0 00000004:00000024:3.0:1788970344.280418:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970344.280419:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082237952 00000100:00100000:1.0:1788970344.280425:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082237952 00000100:00100000:1.0:1788970344.280457:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:1.0:1788970344.280465:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10496:x1875871082237952:12345-192.168.203.15@tcp:700:mkdir.0 00000100:00100000:3.0:1788970344.280546:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2400:x1875871082237824:12345-192.168.203.15@tcp:41:mkdir.0 Request processed in 280us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970344.280546:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10496:x1875871082237952:12345-192.168.203.15@tcp:700:mkdir.0 Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970344.280556:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1788970344.280556:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00080000:2.0:1788970344.280634:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970344.283129:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.283243:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082238208 00000100:00100000:3.0:1788970344.283256:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082238208 00000100:00100000:3.0:1788970344.283329:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:3.0:1788970344.283351:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:10496:x1875871082238208:12345-192.168.203.15@tcp:36:mkdir.0 00010000:00010000:3.0:1788970344.283490:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970344.285643:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6e870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d678 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.285673:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e9700) 00010000:00010000:3.0:1788970344.285976:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970344.287091:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.287110:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.287124:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.291026:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.291052:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.291066:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292755:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292781:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292792:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970344.292813:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007172f257 reply state 00000000119afefd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292823:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292831:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360600) 00010000:00010000:0.0:1788970344.292834:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970344.292838:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788970344.292844:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788970344.292852:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292859:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292865:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292871:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.292876:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292883:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292914:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.292917:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.292921:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292927:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970344.292947:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007172f257 reply state 00000000119afefd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292955:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.292961:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a7d83360d00) 00010000:00010000:0.0:1788970344.292963:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970344.292965:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788970344.293733:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10496:x1875871082238208:12345-192.168.203.15@tcp:36:mkdir.0 Request processed in 10379us (10611us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788970344.293742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1788970344.308332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.308601:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082238336 00000100:00100000:0.0:1788970344.308622:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082238336 00000100:00100000:0.0:1788970344.308682:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:0.0:1788970344.308693:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10497:x1875871082238336:12345-192.168.203.15@tcp:101:chmod.0 00010000:00010000:0.0:1788970344.308718:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970344.308742:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d70b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.308810:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6e9ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.308839:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.308852:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970344.308896:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970344.308899:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970344.308937:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.308963:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d70b expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.308982:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d70b expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.308991:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.308994:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970344.308997:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012000, rc 0) 00000100:00100000:0.0:1788970344.309046:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:10497:x1875871082238336:12345-192.168.203.15@tcp:101:chmod.0 Request processed in 354us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.309053:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1788970344.322696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.324030:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082238592 00000100:00100000:0.0:1788970344.324043:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082238592 00000100:00100000:0.0:1788970344.324112:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970344.324123:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:10497:x1875871082238592:12345-192.168.203.15@tcp:36:chmod.0 00010000:00010000:0.0:1788970344.324186:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970344.324223:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6e9ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d70b expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.324244:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.324256:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970344.324282:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.324295:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.324304:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970344.324546:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb71298 reply state 000000008705e3ae transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.324560:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.324566:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:0.0:1788970344.324569:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788970344.324572:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788970344.324579:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788970344.324675:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:10497:x1875871082238592:12345-192.168.203.15@tcp:36:chmod.0 Request processed in 553us (1987us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788970344.324682:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:1.0:1788970344.375739:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.376311:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082238720 00000100:00100000:3.0:1788970344.376329:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082238720 00000100:00100000:3.0:1788970344.376450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:3.0:1788970344.376463:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+9:10498:x1875871082238720:12345-192.168.203.15@tcp:101:chown.0 00010000:00010000:3.0:1788970344.376996:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970344.377027:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6e9f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d712 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.377110:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6e9ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.377139:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.377155:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970344.378358:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788970344.378369:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970344.378448:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6e9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.378497:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6e9f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d712 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.378546:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6e9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d712 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.378556:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:3.0:1788970344.379716:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970344.379727:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4e00, rc 0) 00000100:00100000:3.0:1788970344.380309:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+10:10498:x1875871082238720:12345-192.168.203.15@tcp:101:chown.0 Request processed in 3368us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970344.380323:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:2.0:1788970344.382771:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.382881:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082238848 00000100:00100000:0.0:1788970344.382891:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082238848 00000100:00100000:0.0:1788970344.382944:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:0.0:1788970344.382955:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+10:10498:x1875871082238848:12345-192.168.203.15@tcp:101:chown.0 00010000:00010000:0.0:1788970344.382990:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970344.383011:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d719 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383077:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383091:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383102:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383113:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383121:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383127:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383196:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383204:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383211:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970344.383249:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970344.383259:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970344.383284:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383296:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383302:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383309:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383316:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.383322:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383329:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383343:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:0.0:1788970344.383347:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.383352:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383375:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383678:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383685:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383702:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383707:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.383711:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383718:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383726:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a7d83360d00) 00010000:00010000:0.0:1788970344.383729:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.383732:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383738:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383769:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d719 expref: 12 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383789:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d719 expref: 11 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.383797:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360600) 00010000:00010000:0.0:1788970344.383799:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970344.383802:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013600, rc 0) 00000100:00100000:0.0:1788970344.384030:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+11:10498:x1875871082238848:12345-192.168.203.15@tcp:101:chown.0 Request processed in 1075us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.384048:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1788970344.391956:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970344.392164:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082238976 00000100:00100000:1.0:1788970344.392275:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082238976 00000100:00100000:1.0:1788970344.392411:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:1.0:1788970344.392425:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76727560-d4e0-4213-a4e0-b609fd69db0f+11:10498:x1875871082238976:12345-192.168.203.15@tcp:900:chown.0 00000100:00100000:1.0:1788970344.392983:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76727560-d4e0-4213-a4e0-b609fd69db0f+11:10498:x1875871082238976:12345-192.168.203.15@tcp:900:chown.0 Request processed in 556us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970344.392993:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1788970344.405835:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.405978:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082239232 00000100:00100000:0.0:1788970344.405993:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082239232 00000100:00100000:0.0:1788970344.406071:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1788970344.406085:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+11:10498:x1875871082239232:12345-192.168.203.15@tcp:36:chown.0 00010000:00010000:0.0:1788970344.406159:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970344.406197:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d719 expref: 11 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.406225:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360600) 00010000:00010000:0.0:1788970344.406231:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970344.406265:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.406279:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.406288:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970344.412851:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1788970344.412978:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000588f01ea reply state 00000000f30f2d38 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.413007:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.413018:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360600) 00010000:00010000:0.0:1788970344.413021:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788970344.413027:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788970344.413059:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788970344.413180:0:6524:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788970344.413201:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:10498:x1875871082239232:12345-192.168.203.15@tcp:36:chown.0 Request processed in 7114us (7374us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788970344.413211:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00010000:00010000:3.0:1788970344.413461:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413471:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413480:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413486:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970344.413492:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413500:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413514:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a7d83360d00) 00010000:00010000:3.0:1788970344.413517:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970344.413529:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413536:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6e9d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413562:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413569:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413575:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.413581:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970344.413584:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.413961:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.413971:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.413977:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.413982:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970344.413985:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.413992:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.414005:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360600) 00010000:00010000:1.0:1788970344.414008:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788970344.414021:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.414030:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6ea22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417848:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417877:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360600) 00010000:00010000:3.0:1788970344.417880:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970344.417888:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417896:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6e9dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417935:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417942:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417968:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417974:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970344.417979:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417985:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.417992:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:3.0:1788970344.417994:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970344.417997:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.418003:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6e9f1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970344.430788:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.430928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082239360 00000100:00100000:3.0:1788970344.430942:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082239360 00000100:00100000:3.0:1788970344.431014:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:3.0:1788970344.431026:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:10499:x1875871082239360:12345-192.168.203.15@tcp:101:touch.500 00010000:00010000:3.0:1788970344.431058:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970344.431084:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ea29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d720 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970344.434111:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2961us 00010000:00010000:0.0:1788970344.449692:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449725:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449741:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449762:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449772:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449781:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449964:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449975:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.449984:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970344.450020:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970344.450030:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970344.450080:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450095:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450102:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450111:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450117:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.450123:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450131:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450146:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:0.0:1788970344.450149:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.450156:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450163:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450176:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450182:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450198:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450203:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.450206:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450213:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450221:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.450224:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.450227:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450233:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450285:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ea29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d720 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450306:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d720 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.450320:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:0.0:1788970344.450322:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788970344.450325:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013800, rc 0) 00000100:00100000:0.0:1788970344.450445:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10499:x1875871082239360:12345-192.168.203.15@tcp:101:touch.500 Request processed in 19419us (19670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.450466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1788970344.454340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.454432:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082239616 00000100:00100000:3.0:1788970344.454466:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082239616 00000100:00100000:3.0:1788970344.454550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1788970344.454562:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82549e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10499:x1875871082239616:12345-192.168.203.15@tcp:101:touch.500 00010000:00010000:3.0:1788970344.454707:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970344.454738:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea45 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d727 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.454892:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.454911:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.454925:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.454943:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.454950:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.454957:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970344.456180:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788970344.456414:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ea5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456431:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ea5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456455:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ea5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456496:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456565:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456574:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456581:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970344.456586:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456658:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456674:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:3.0:1788970344.456677:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970344.456683:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456689:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970344.456706:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b9b597e reply state 000000008a42f412 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456717:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456828:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff8a7d823edc00) 00010000:00010000:3.0:1788970344.456831:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970344.456834:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788970344.456876:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d727 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456893:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ea5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d727 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.456901:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d823edf00) 00010000:00010000:3.0:1788970344.456903:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970344.456905:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4400, rc 0) 00000100:00100000:3.0:1788970344.457155:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82549e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+10:10499:x1875871082239616:12345-192.168.203.15@tcp:101:touch.500 Request processed in 2594us (2827us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788970344.457164:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:1.0:1788970344.460554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.460700:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082239872 00000100:00100000:0.0:1788970344.460715:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082239872 00000100:00100000:0.0:1788970344.460842:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:0.0:1788970344.460856:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb59592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+10:10499:x1875871082239872:12345-192.168.203.15@tcp:36:touch.500 00010000:00010000:0.0:1788970344.460937:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970344.460972:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ea5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d727 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.461000:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d823edf00) 00010000:00010000:0.0:1788970344.461025:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970344.461110:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.461126:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.461137:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970344.461276:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006a1a57b reply state 000000005804b10c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.461290:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.461297:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.461300:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970344.461302:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970344.461479:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb59592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+11:10499:x1875871082239872:12345-192.168.203.15@tcp:36:touch.500 Request processed in 626us (938us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788970344.461488:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:0.0:1788970344.465935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970344.466066:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082240000 00000100:00100000:1.0:1788970344.466080:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082240000 00000100:00100000:1.0:1788970344.466152:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:1.0:1788970344.466165:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+11:10499:x1875871082240000:12345-192.168.203.15@tcp:101:touch.500 00010000:00010000:1.0:1788970344.466198:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970344.466227:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ea6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d72e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.466298:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ea6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d72e expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.466315:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ea6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d72e expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970344.466334:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:1.0:1788970344.466337:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970344.466342:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654a00, rc 0) 00000100:00100000:1.0:1788970344.466443:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+12:10499:x1875871082240000:12345-192.168.203.15@tcp:101:touch.500 Request processed in 282us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970344.466451:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:2.0:1788970344.472288:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.474251:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082240128 00000100:00100000:0.0:1788970344.474269:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082240128 00000100:00100000:0.0:1788970344.474343:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:0.0:1788970344.474354:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082240128:12345-192.168.203.15@tcp:8:touch.500 00010000:00080000:0.0:1788970344.474432:0:8442:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:0.0:1788970344.474514:0:8442:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6ea76 00002000:00100000:0.0:1788970344.474531:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76727560-d4e0-4213-a4e0-b609fd69db0f/ffff8a7ebf3e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970344.474552:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788970344.474791:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970344.474835:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3ea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970344.474923:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082240128:12345-192.168.203.15@tcp:8:touch.500 Request processed in 568us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.474932:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00010000:00010000:0.0:1788970344.476912:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970344.477457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.478170:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082240256 00000100:00100000:0.0:1788970344.478185:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082240256 00000100:00100000:0.0:1788970344.478345:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970344.478358:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082240256:12345-192.168.203.15@tcp:2:touch.500 00000100:00080000:2.0:1788970344.478935:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788970344.491904:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1788970344.491924:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000100:00100000:1.0:1788970344.496043:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:0:x1875871082240256:12345-192.168.203.15@tcp:2:touch.500 Request processed in 17670us (18575us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788970344.496061:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1788970344.500936:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.501062:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082240512 00000100:00100000:3.0:1788970344.501076:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082240512 00000100:00100000:3.0:1788970344.501156:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970344.501173:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+12:10499:x1875871082240512:12345-192.168.203.15@tcp:35:touch.500 00000100:00100000:3.0:1788970344.501776:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+13:10499:x1875871082240512:12345-192.168.203.15@tcp:35:touch.500 Request processed in 601us (849us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788970344.501786:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:2.0:1788970344.516585:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.516756:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082240640 00000100:00100000:3.0:1788970344.516798:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082240640 00000100:00100000:3.0:1788970344.516877:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:3.0:1788970344.516890:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+13:10500:x1875871082240640:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:3.0:1788970344.516931:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970344.516957:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d735 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.517044:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.517062:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.517077:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970344.517140:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788970344.517144:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970344.517366:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.517456:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d735 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.517483:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d735 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.517495:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:3.0:1788970344.517499:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970344.517731:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4600, rc 0) 00000100:00100000:0.0:1788970344.518501:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+14:10500:x1875871082240640:12345-192.168.203.15@tcp:101:rm.0 Request processed in 1607us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.518512:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:1.0:1788970344.527248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.527429:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082240896 00000100:00100000:3.0:1788970344.527444:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082240896 00000100:00100000:3.0:1788970344.527520:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1788970344.527531:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+14:10500:x1875871082240896:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:3.0:1788970344.527558:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970344.527585:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d73c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970344.527737:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788970344.528111:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d73c expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.528476:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:3.0:1788970344.528481:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970344.528488:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6ea8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d73c expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.528510:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4800, rc 0) 00000100:00100000:3.0:1788970344.528599:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+15:10500:x1875871082240896:12345-192.168.203.15@tcp:101:rm.0 Request processed in 1068us (1362us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788970344.528616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:2.0:1788970344.550872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.551142:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082241024 00000100:00100000:3.0:1788970344.551156:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082241024 00000100:00100000:3.0:1788970344.551234:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1788970344.551247:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:10500:x1875871082241024:12345-192.168.203.15@tcp:37:rm.0 00000100:00100000:0.0:1788970344.569052:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:10500:x1875871082241024:12345-192.168.203.15@tcp:37:rm.0 Request processed in 17797us (18188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.569075:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:1.0:1788970344.579216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.579745:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082241280 00000100:00100000:0.0:1788970344.579756:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082241280 00000100:00100000:0.0:1788970344.579823:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1788970344.579833:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+15:10500:x1875871082241280:12345-192.168.203.15@tcp:35:rm.0 00000100:00100000:0.0:1788970344.580042:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+16:10500:x1875871082241280:12345-192.168.203.15@tcp:35:rm.0 Request processed in 210us (835us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788970344.580050:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1788970344.586982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.588646:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082241536 00000100:00100000:0.0:1788970344.588661:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082241536 00000100:00100000:0.0:1788970344.588735:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:0.0:1788970344.588745:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82549680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+16:10500:x1875871082241536:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:0.0:1788970344.588767:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970344.588786:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d743 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.588880:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6eaa0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.588894:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6eaa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.588903:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6eaa0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970344.588913:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788970344.589010:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ea99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d743 expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.589048:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6eaa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d743 expref: 18 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.589058:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:0.0:1788970344.589061:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970344.589064:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013200, rc 0) 00000100:00100000:0.0:1788970344.589133:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82549680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082241536:12345-192.168.203.15@tcp:101:rm.0 Request processed in 389us (2159us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788970344.589141:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:1.0:1788970344.593453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.593561:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082241664 00000100:00100000:0.0:1788970344.593571:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082241664 00000100:00100000:0.0:1788970344.593637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1788970344.593649:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082241664:12345-192.168.203.15@tcp:41:rm.0 00000004:00000024:0.0:1788970344.593704:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788970344.593773:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082241664:12345-192.168.203.15@tcp:41:rm.0 Request processed in 126us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.593781:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:1.0:1788970344.597722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.597835:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082241792 00000100:00100000:0.0:1788970344.597851:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082241792 00000100:00100000:0.0:1788970344.597926:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:0.0:1788970344.597939:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082241792:12345-192.168.203.15@tcp:101:rm.0 00010000:00010000:0.0:1788970344.597958:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970344.597979:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eaae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d74a expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598066:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598080:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598092:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598102:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598109:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598115:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598187:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598195:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598201:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970344.598233:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788970344.598237:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970344.598252:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598271:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598279:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598285:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598291:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598297:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.598301:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598308:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598319:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:0.0:1788970344.598322:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.598326:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598332:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6eab5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598345:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598351:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598361:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598366:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970344.598369:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598375:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598427:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff8a7d823edc00) 00010000:00010000:0.0:1788970344.598430:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970344.598434:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598441:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eabc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598468:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eaae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d74a expref: 20 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598484:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d74a expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.598490:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.598492:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970344.598494:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012c00, rc 0) 00000100:00100000:0.0:1788970344.598551:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+19:10500:x1875871082241792:12345-192.168.203.15@tcp:101:rm.0 Request processed in 615us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.598565:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:2.0:1788970344.612652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970344.612737:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082242048 00000100:00100000:2.0:1788970344.612751:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082242048 00000100:00100000:2.0:1788970344.612830:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:2.0:1788970344.612843:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+19:10500:x1875871082242048:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:2.0:1788970344.612924:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788970344.612962:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012c00/0xc3abfebe76c6eac3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d74a expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.612992:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ea6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d72e expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613029:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:2.0:1788970344.613042:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6ea84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d735 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613054:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:2.0:1788970344.613058:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970344.613085:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613101:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613112:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613123:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613131:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613138:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613417:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613428:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.613446:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970344.613810:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788970344.613821:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363880439159ns, next at 364880435656ns, rc = 0 00010000:00010000:2.0:1788970344.614084:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614095:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614104:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614113:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614119:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614125:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614151:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970344.614177:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614184:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614191:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614627:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970344.614633:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614642:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614657:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:2.0:1788970344.614661:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788970344.614669:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614676:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c6ead8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614703:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614710:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614718:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614723:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970344.614728:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614735:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614755:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:2.0:1788970344.614758:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970344.614762:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614767:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c6eaca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.614775:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:2.0:1788970344.614781:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001476ac4e reply state 0000000000b3ee6a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.614789:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614795:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.614811:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970344.614814:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff8a7d823edc00) 00010000:00010000:0.0:1788970344.614819:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970344.614820:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970344.614828:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788970344.614841:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.614858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:0.0:1788970344.614861:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788970344.614866:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.614872:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c6eadf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970344.614888:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970344.614890:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970344.614892:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970344.614957:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082242048:12345-192.168.203.15@tcp:36:rm.0 Request processed in 2112us (2316us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788970344.614969:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:1.0:1788970344.621213:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970344.621304:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082242304 00000100:00100000:0.0:1788970344.621314:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082242304 00000100:00100000:0.0:1788970344.621374:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:0.0:1788970344.621423:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082242304:12345-192.168.203.15@tcp:35:rm.0 00000100:00100000:0.0:1788970344.621670:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+19:10500:x1875871082242304:12345-192.168.203.15@tcp:35:rm.0 Request processed in 287us (466us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788970344.621693:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:0.0:1788970344.629866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.629987:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082242560 00000100:00100000:3.0:1788970344.629997:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082242560 00000100:00100000:3.0:1788970344.630069:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1788970344.630079:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+19:10500:x1875871082242560:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:3.0:1788970344.630133:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788970344.630157:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6eaa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d743 expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630181:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ea3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d720 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630192:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d83360a00) 00010000:00010000:3.0:1788970344.630208:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6e9ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d712 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630219:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360f00) 00010000:00010000:3.0:1788970344.630224:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970344.630246:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630258:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630268:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630280:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630286:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630303:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630376:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630431:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630438:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970344.630682:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788970344.630697:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630704:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630710:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630717:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970344.630721:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630728:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630737:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a7d823eda00) 00010000:00010000:3.0:1788970344.630740:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788970344.630751:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630757:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6eaf4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630775:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630781:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630788:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630793:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970344.630795:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630801:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630808:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823edd00) 00010000:00010000:3.0:1788970344.630810:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970344.630813:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630820:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c6eae6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970344.630829:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e01ab72 reply state 00000000b30e03d2 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630849:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970344.630855:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a7d823ed600) 00010000:00010000:3.0:1788970344.630858:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970344.630860:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970344.630930:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+18:10500:x1875871082242560:12345-192.168.203.15@tcp:36:rm.0 Request processed in 851us (1072us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788970344.630938:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1788970344.646080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.646125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.646149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.646183:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970344.646211:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082242816 00000100:00100000:3.0:1788970344.646220:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082242816 00000100:00100000:3.0:1788970344.646268:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243072 00000100:00100000:3.0:1788970344.646271:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243072 00000100:00100000:3.0:1788970344.646283:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082242944 00000100:00100000:3.0:1788970344.646285:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082242944 00000100:00100000:3.0:1788970344.646299:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:3.0:1788970344.646308:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082242816:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970344.646366:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082242816:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970344.646373:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:3.0:1788970344.646416:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:3.0:1788970344.646422:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082243072:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970344.646457:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082243072:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 36us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970344.646464:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:3.0:1788970344.646473:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:3.0:1788970344.646478:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082242944:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970344.646511:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082242944:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 16us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970344.646517:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:2.0:1788970344.646639:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082242688 00000100:00100000:2.0:1788970344.646643:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082242688 00000100:00100000:2.0:1788970344.646675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 332 00000100:00100000:2.0:1788970344.646681:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082242688:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970344.646703:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082242688:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970344.646709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 332 00000100:00080000:2.0:1788970344.646731:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970344.646740:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970344.732720:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970344.732741:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102247424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970344.732802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970344.732919:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247424 00000100:00100000:0.0:1788970344.732927:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247424 00000100:00100000:0.0:1788970344.732977:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788970344.732985:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102247424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970344.733009:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788970344.733052:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102247424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970344.733059:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788970344.733133:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102247424:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788970345.501130:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970346.271793:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5824780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102247552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970346.271869:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970346.275189:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247552 00000100:00100000:1.0:1788970346.275204:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247552 00000100:00100000:1.0:1788970346.275266:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788970346.275277:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102247552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970346.275312:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788970346.275408:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102247552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970346.275415:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788970346.275465:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5824780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102247552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970346.524700:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970347.292600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788970347.292622:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102247680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.292681:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102247936:0@lo:400:kworker.0 00000100:00100000:1.0:1788970347.292685:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102248064:0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.292698:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970347.292731:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970347.292733:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970347.292751:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102247808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970347.292753:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102248576:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.292768:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102248448:0@lo:400:kworker.0 00000100:00100000:1.0:1788970347.292776:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970347.292800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970347.292800:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102249216:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.292822:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102248960:0@lo:400:kworker.0 00000100:00100000:1.0:1788970347.292831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970347.292855:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102249088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970347.292870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970347.292886:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970347.292907:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247936 00000100:00100000:3.0:1788970347.292911:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247680 00000100:00100000:2.0:1788970347.292914:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247936 00000100:00100000:3.0:1788970347.292918:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247680 00000100:00100000:1.0:1788970347.292927:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248576 00000100:00100000:1.0:1788970347.292932:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248576 00000100:00100000:3.0:1788970347.292966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788970347.292969:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248448 00000100:00100000:2.0:1788970347.292973:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248448 00000100:00100000:3.0:1788970347.292979:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102247680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970347.292981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249216 00000100:00100000:1.0:1788970347.292986:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249216 00000100:00100000:2.0:1788970347.292987:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248960 00000100:00100000:2.0:1788970347.292989:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248960 00000100:00100000:1.0:1788970347.293001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788970347.293008:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102247936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.293041:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102247680:12345-0@lo:400:kworker.0 Request processed in 66us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970347.293057:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102247936:12345-0@lo:400:kworker.0 Request processed in 48us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970347.293061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788970347.293100:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248064 00000100:00100000:3.0:1788970347.293105:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248064 00000100:00100000:0.0:1788970347.293119:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102248320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.293132:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788970347.293140:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102248064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.293154:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970347.293181:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102248832:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.293190:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102248064:12345-0@lo:400:kworker.0 Request processed in 50us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970347.293197:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788970347.293210:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970347.293211:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248320 00000100:00100000:3.0:1788970347.293216:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248320 00000100:00100000:0.0:1788970347.293232:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102249472:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.293235:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788970347.293244:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5827c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102248320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.293259:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970347.295100:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102248320:0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.295120:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788970347.295130:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102248192:0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.295186:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5827c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102248320:12345-0@lo:400:kworker.0 Request processed in 1940us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970347.295197:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788970347.295203:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788970347.295216:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.295231:0:10102:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788970347.295240:0:10102:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788970347.295273:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102248576:12345-0@lo:400:kworker.0 Request processed in 61us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970347.295279:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788970347.295292:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788970347.295298:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102248448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295332:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102248448:12345-0@lo:400:kworker.0 Request processed in 35us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970347.295337:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788970347.295349:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788970347.295355:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102249216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295376:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102249216:12345-0@lo:400:kworker.0 Request processed in 22us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970347.295409:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788970347.295420:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788970347.295426:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102248960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295451:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102248960:12345-0@lo:400:kworker.0 Request processed in 26us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970347.295456:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788970347.295475:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249088 00000100:00100000:2.0:1788970347.295480:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249088 00000100:00100000:2.0:1788970347.295506:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788970347.295512:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102249088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970347.295532:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970347.295569:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102249088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970347.295575:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788970347.295599:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970347.295604:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970347.295606:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970347.295619:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970347.295648:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102247680:0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295669:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102247808 00000100:00100000:2.0:1788970347.295672:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102247808 00000100:00100000:3.0:1788970347.295700:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102247936:0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295710:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788970347.295719:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102248448:0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295719:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102247808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970347.295735:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970347.295740:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102248960:0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295764:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102247808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970347.295783:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102248064:0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.295794:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788970347.295804:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf376d00 x1875871102248576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788970347.295812:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970347.295819:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102248576:0@lo:400:kworker.0 00010000:00080000:2.0:1788970347.295832:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d82548b40 x1875871102247808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970347.295850:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102247808:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788970347.295851:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366f480 x1875871102249216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970347.295871:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102249216:0@lo:400:kworker.0 00010000:00080000:3.0:1788970347.295885:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338a940 x1875871102249088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970347.296012:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102249088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970347.296022:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248832 00000100:00100000:2.0:1788970347.296027:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248832 00000100:00100000:2.0:1788970347.296054:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249472 00000100:00100000:2.0:1788970347.296057:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249472 00000100:00080000:3.0:1788970347.296078:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970347.296079:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788970347.296086:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102248832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970347.296096:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788970347.296106:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102249472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970347.296121:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102248832:12345-0@lo:400:kworker.0 Request processed in 34us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970347.296127:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788970347.296154:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102249472:12345-0@lo:400:kworker.0 Request processed in 49us (2894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970347.296163:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788970347.298537:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970347.298597:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102248704:0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.298631:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970347.298653:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102249344:0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.298670:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788970347.298843:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf374000 x1875871102248832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970347.298858:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102248832:0@lo:400:kworker.0 00010000:00080000:0.0:1788970347.298869:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366fc00 x1875871102249472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970347.298876:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102249472:0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.298913:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248704 00000100:00100000:0.0:1788970347.298919:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248704 00000100:00100000:0.0:1788970347.299204:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249344 00000100:00100000:0.0:1788970347.299209:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249344 00000100:00100000:0.0:1788970347.299233:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788970347.299241:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102248704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.299469:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102248704:12345-0@lo:400:kworker.0 Request processed in 228us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970347.299476:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788970347.299494:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970347.299501:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102249344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.299530:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102249344:12345-0@lo:400:kworker.0 Request processed in 30us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970347.299536:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788970347.299557:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788970347.299580:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377480 x1875871102248704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970347.301294:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788970347.301337:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102248192 00000100:00100000:1.0:1788970347.301345:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102248192 00000100:00100000:1.0:1788970347.301401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788970347.301410:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5825e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102248192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970347.301478:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5825e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102248192:12345-0@lo:400:kworker.0 Request processed in 70us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970347.301484:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788970347.302700:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102248704:0@lo:400:kworker.0 00010000:00080000:0.0:1788970347.302731:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366c780 x1875871102249344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970347.302755:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102249344:0@lo:400:kworker.0 00000100:00100000:0.0:1788970347.302905:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102248192:0@lo:400:kworker.0 00010000:00010000:1.0:1788970347.549719:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970348.332994:0:13689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788970348.601830:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970348.828852:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102249600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970348.828919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970348.828994:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249600 00000100:00100000:2.0:1788970348.829003:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249600 00000100:00100000:2.0:1788970348.829049:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788970348.829061:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102249600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970348.829093:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970348.829143:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102249600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970348.829152:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788970348.829212:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d82548b40 x1875871102249600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970348.829243:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d82548b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102249600:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788970348.829478:0:8687:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368096094831ns, next at 369096091880ns, rc = 0 00000100:00100000:2.0:1788970348.829606:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970348.829616:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102249728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970348.829644:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970348.837776:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249728 00000100:00100000:1.0:1788970348.837795:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249728 00000100:00100000:1.0:1788970348.837865:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970348.837877:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102249728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970348.837903:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970348.837990:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102249728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (8345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970348.837997:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788970348.838988:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366c000 x1875871102249728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970348.839027:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102249728:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788970349.319856:0:13739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfde34350 20000000:00000080:3.0:1788970349.319871:0:13739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7e81326c00 uarg=0000000000000000 20000000:01000000:3.0:1788970349.319909:0:13739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788970349.319915:0:13739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788970349.319920:0:13739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788970349.320267:0:13740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788970349.320669:0:13739:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788970349.324994:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788970349.325035:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788970349.325050:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788970349.325066:0:13739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788970349.325086:0:13739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325120:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325128:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325136:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325142:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325149:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325155:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325161:0:13739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325195:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325210:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 23 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.325225:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102249856:0@lo:104: 00000100:00100000:3.0:1788970349.325286:0:13739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970349.325447:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325456:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 23 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.325464:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102249984:0@lo:104: 00010000:00010000:3.0:1788970349.325496:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325504:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 23 pid: 6516 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.325512:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250112:0@lo:104: 00010000:00010000:3.0:1788970349.325527:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325534:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 23 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.325541:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250240:0@lo:104: 00010000:00010000:3.0:1788970349.325565:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325583:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 12 pid: 6516 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.325591:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250368:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970349.325638:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.325652:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 12 pid: 6518 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.325660:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250496:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970349.325680:0:13739:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970349.331810:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970349.331850:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970349.331879:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243200 00000100:00100000:3.0:1788970349.331888:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243200 00010000:00010000:3.0:1788970349.331924:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 13 pid: 6516 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.331950:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243328 00000100:00100000:3.0:1788970349.331954:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243328 00010000:00010000:3.0:1788970349.331964:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 14 pid: 6518 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970349.331984:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:3.0:1788970349.331993:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+14:2402:x1875871082243200:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970349.332008:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970349.332014:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 14 pid: 6516 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.332025:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 14 pid: 6516 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.332044:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970349.332112:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+14:2402:x1875871082243200:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 119us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970349.332120:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:3.0:1788970349.332136:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1788970349.332142:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082243328:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970349.332150:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970349.332154:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 13 pid: 6518 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.332163:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 13 pid: 6518 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970349.332173:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970349.332193:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082243328:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 51us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970349.332199:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1788970349.332493:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788970349.332516:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.332540:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.332580:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.332590:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249856 00000100:00100000:0.0:1788970349.332594:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249856 00000100:00100000:0.0:1788970349.332605:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102249984 00000100:00100000:0.0:1788970349.332607:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102249984 00000100:00100000:0.0:1788970349.332625:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102250112 00000100:00100000:0.0:1788970349.332627:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102250112 00000100:00100000:0.0:1788970349.332634:0:10401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102250240 00000100:00100000:0.0:1788970349.332637:0:10401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102250240 00000100:00100000:0.0:1788970349.332646:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970349.332651:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:13739:x1875871102249984:12345-0@lo:104: 00010000:00010000:0.0:1788970349.332661:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332698:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970349.332703:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+6:13739:x1875871102249984:12345-0@lo:104: Request processed in 52us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.332708:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970349.332719:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788970349.332735:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:13739:x1875871102250112:12345-0@lo:104: 00010000:00010000:0.0:1788970349.332742:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332781:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788970349.332785:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+5:13739:x1875871102250112:12345-0@lo:104: Request processed in 61us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.332791:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788970349.332801:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970349.332806:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:13739:x1875871102250240:12345-0@lo:104: 00010000:00010000:0.0:1788970349.332812:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332831:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788970349.332835:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+4:13739:x1875871102250240:12345-0@lo:104: Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.332839:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1788970349.332852:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788970349.332857:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332863:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970349.332867:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332876:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970349.332883:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970349.332889:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970349.332920:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332926:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970349.332943:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332950:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae012200/0xc3abfebe76c6e9b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332961:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970349.332964:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332970:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970349.332973:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.332979:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970349.332985:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970349.332990:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970349.332998:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333003:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970349.333007:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333022:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82655600/0xc3abfebe76c6e9a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9ab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333029:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970349.333032:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333037:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970349.333040:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333046:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970349.333052:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970349.333056:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970349.333065:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333069:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970349.333081:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333087:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c6e996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e99d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333094:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970349.333100:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970349.333102:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970349.333116:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102250624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333146:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.333176:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970349.333182:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102250752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333202:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.333226:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102250880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.333265:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102250624 00000100:00100000:0.0:1788970349.333269:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102250624 00010000:00010000:0.0:1788970349.333282:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 24 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.333294:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102250752 00000100:00100000:0.0:1788970349.333295:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102250752 00010000:00010000:0.0:1788970349.333303:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 25 pid: 6516 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.333311:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102250880 00000100:00100000:0.0:1788970349.333312:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102250880 00010000:00010000:0.0:1788970349.333319:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 26 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.333328:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970349.333333:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3651:x1875871102250624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970349.333342:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970349.333346:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 26 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333364:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 26 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333375:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970349.333420:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3651:x1875871102250624:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.333426:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788970349.333441:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788970349.333446:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+25:3651:x1875871102250752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970349.333454:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970349.333458:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 25 pid: 6516 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333466:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 25 pid: 6516 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333474:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970349.333491:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+25:3651:x1875871102250752:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.333497:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788970349.333506:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970349.333511:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102250880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970349.333517:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970349.333520:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 24 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333527:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 24 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333541:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970349.333560:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102250880:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.333566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970349.333604:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102250752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333611:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102250624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102250880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333657:0:10401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788970349.333662:0:10401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef93450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13739:x1875871102249856:12345-0@lo:104: 00010000:00010000:0.0:1788970349.333670:0:10401:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333695:0:10401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970349.333699:0:10401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef93450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5fe147a8-4210-48cf-8358-c541b06e4cd0+3:13739:x1875871102249856:12345-0@lo:104: Request processed in 38us (8415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.333705:0:10401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788970349.333734:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970349.333737:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333743:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970349.333746:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333753:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970349.333765:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970349.333770:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970349.333784:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333789:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970349.333799:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333805:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654000/0xc3abfebe76c6e9c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6e9c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333817:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970349.333818:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970349.333819:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970349.333826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102251008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970349.333845:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970349.333865:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251008 00000100:00100000:0.0:1788970349.333868:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251008 00010000:00010000:0.0:1788970349.333879:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 24 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.333892:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788970349.333896:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102251008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970349.333902:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970349.333905:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 24 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333918:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 24 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333930:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333938:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333950:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333957:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333963:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333969:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333974:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970349.333978:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333985:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.333993:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.334011:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970349.334035:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102251008:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.334041:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788970349.334062:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102251008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970349.334862:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970349.335762:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c6e98f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d704 expref: 12 pid: 6516 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970349.335779:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250368:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970349.335917:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae013400/0xc3abfebe76c6e988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6fd expref: 11 pid: 6518 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.335929:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250496:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970349.335940:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c6e9c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e9c0 expref: 23 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.335948:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102249856:0@lo:104: 00010000:00010000:0.0:1788970349.335956:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6e9b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e9b2 expref: 22 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.335963:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102249984:0@lo:104: 00010000:00010000:0.0:1788970349.335970:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c6e9ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e9a4 expref: 21 pid: 6516 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.335977:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250112:0@lo:104: 00010000:00010000:0.0:1788970349.335984:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012a00/0xc3abfebe76c6e99d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6e996 expref: 20 pid: 6518 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970349.335991:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875871102250240:0@lo:104: 00010000:00010000:0.0:1788970349.336019:0:13739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.336038:0:13739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.336045:0:13739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.336051:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4400/0xc3abfebe76c6eafb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970349.597850:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970349.763086:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970349.763590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970349.763686:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970349.763813:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243584 00000100:00100000:0.0:1788970349.763823:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243584 00000100:00100000:0.0:1788970349.763893:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243840 00000100:00100000:0.0:1788970349.763896:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243840 00000100:00100000:0.0:1788970349.763915:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00100000:0.0:1788970349.763925:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d82548780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082243584:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970349.763988:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d82548780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082243584:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 65us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.763995:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00100000:0.0:1788970349.764013:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 211 00000100:00100000:0.0:1788970349.764019:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082243840:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970349.764044:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082243840:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970349.764050:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 211 00000100:00080000:1.0:1788970349.764918:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970349.764936:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970349.764953:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970349.764980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970349.767348:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243712 00000100:00100000:2.0:1788970349.767361:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243712 00000100:00100000:2.0:1788970349.767442:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00100000:2.0:1788970349.767452:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082243712:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970349.767514:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082243712:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 64us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970349.767521:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00080000:2.0:1788970349.767851:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970349.769044:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243456 00000100:00100000:3.0:1788970349.769055:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243456 00000100:00100000:3.0:1788970349.769131:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082243968 00000100:00100000:3.0:1788970349.769135:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082243968 00000100:00100000:3.0:1788970349.769159:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 212 00000100:00100000:3.0:1788970349.769167:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2400:x1875871082243456:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970349.769233:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2400:x1875871082243456:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 67us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970349.769240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 212 00000100:00100000:3.0:1788970349.769255:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 213 00000100:00100000:3.0:1788970349.769262:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83591680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082243968:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970349.769301:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83591680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082243968:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (4320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970349.769308:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 213 00000100:00080000:2.0:1788970349.771988:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970349.771997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970349.852522:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970349.852547:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102251136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970349.852625:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970349.852740:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251136 00000100:00100000:2.0:1788970349.852749:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251136 00000100:00100000:2.0:1788970349.852818:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788970349.852829:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102251136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970349.852864:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970349.852933:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102251136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970349.852941:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788970349.853963:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102251136:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788970350.129541:0:13788:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd664a9470 20000000:00000080:3.0:1788970350.129633:0:13788:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7e81326c00 uarg=0000000000000000 20000000:01000000:3.0:1788970350.129681:0:13788:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788970350.129687:0:13788:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788970350.129692:0:13788:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788970350.130074:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788970350.130306:0:13788:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788970350.130373:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788970350.133954:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788970350.134011:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788970350.134036:0:13788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788970350.134058:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134073:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134083:0:13788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134089:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134095:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134109:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134115:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970350.134119:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134126:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134139:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134147:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.134152:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c6eb02 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970350.134984:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788970350.135039:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788970350.135051:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788970350.135142:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970350.135165:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102251264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788970350.135223:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.135249:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251264 00000100:00100000:2.0:1788970350.135258:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251264 00000100:00100000:2.0:1788970350.135316:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970350.135326:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102251264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788970350.135349:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788970350.135378:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa18568, atime: 0x6aa18568, ctime: 0x6aa18568, blocks: 0x0 00010000:00010000:2.0:1788970350.135409:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.135422:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1788970350.135426:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970350.135432:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.135449:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.135475:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.135483:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.135507:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970350.135603:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970350.135611:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.135621:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970350.135626:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.135636:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.135653:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.135661:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066677a68/0xc3abfebe76c6eb09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970350.135666:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102251264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 340us (440us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788970350.135679:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788970350.135685:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970350.135688:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970350.135691:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970350.135707:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788970350.135721:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d836e70c0/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788970350.135727:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102251264:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788970350.136451:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136461:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136467:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136473:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970350.136477:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136490:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136502:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff8a7d823edc00) 00010000:00010000:3.0:1788970350.136505:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970350.136509:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136515:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ea53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136530:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136537:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136542:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136563:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970350.136573:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136578:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136586:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a7d83360200) 00010000:00010000:3.0:1788970350.136588:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970350.136592:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136606:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ea68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136625:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136630:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136636:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136641:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970350.136644:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136650:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136657:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff8a7d823edc00) 00010000:00010000:3.0:1788970350.136659:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970350.136661:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136666:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ead1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136678:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136684:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136694:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136700:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970350.136702:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136708:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136715:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a7d823ed600) 00010000:00010000:3.0:1788970350.136717:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970350.136719:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.136725:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c6eaed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970350.466367:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970350.466554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244096 00000100:00100000:3.0:1788970350.466577:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244096 00000100:00100000:3.0:1788970350.466636:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 334 00000100:00100000:3.0:1788970350.466648:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:6174:x1875871082244096:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970350.466665:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970350.466685:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4600/0xc3abfebe76c6eb10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d751 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.466719:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4600/0xc3abfebe76c6eb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d751 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.466750:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4600/0xc3abfebe76c6eb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d751 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.466759:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4600, rc 0) 00000100:00100000:3.0:1788970350.466851:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082244096:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 205us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970350.466857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 334 00000100:00100000:3.0:1788970350.485190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970350.485312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244224 00000100:00100000:2.0:1788970350.485324:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244224 00000100:00100000:2.0:1788970350.485410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 335 00000100:00100000:2.0:1788970350.485422:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082244224:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.485615:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082244224:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 195us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.485623:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 335 00000100:00100000:2.0:1788970350.492990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970350.493099:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244352 00000100:00100000:0.0:1788970350.493109:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244352 00000100:00100000:0.0:1788970350.493165:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 336 00000100:00100000:0.0:1788970350.493174:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082244352:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.493343:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082244352:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 168us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.493351:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 336 00000100:00100000:1.0:1788970350.509236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970350.509847:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244480 00000100:00100000:3.0:1788970350.509858:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244480 00000100:00100000:3.0:1788970350.509920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 337 00000100:00100000:3.0:1788970350.509932:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:10784:x1875871082244480:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970350.510089:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:10784:x1875871082244480:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 158us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970350.510097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 337 00000100:00100000:3.0:1788970350.524368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970350.524640:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244608 00000100:00100000:2.0:1788970350.524650:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244608 00000100:00100000:2.0:1788970350.524713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 338 00000100:00100000:2.0:1788970350.524725:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:10784:x1875871082244608:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970350.524896:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:10784:x1875871082244608:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 173us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.524904:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 338 00000100:00100000:2.0:1788970350.535009:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970350.536640:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244736 00000100:00100000:0.0:1788970350.536666:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244736 00000100:00100000:0.0:1788970350.536737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 339 00000100:00100000:0.0:1788970350.536747:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:6174:x1875871082244736:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970350.536762:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970350.536779:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6eb17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d758 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.536807:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6eb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d758 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.536818:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6eb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d758 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.536826:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012200, rc 0) 00000100:00100000:0.0:1788970350.536887:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082244736:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 141us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.536895:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 339 00000100:00100000:1.0:1788970350.545428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970350.546939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244864 00000100:00100000:0.0:1788970350.546951:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244864 00000100:00100000:0.0:1788970350.547019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 340 00000100:00100000:0.0:1788970350.547040:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082244864:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.547208:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082244864:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 179us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.547232:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 340 00000100:00100000:3.0:1788970350.558605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970350.558798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082244992 00000100:00100000:2.0:1788970350.558808:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082244992 00000100:00100000:2.0:1788970350.558867:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 341 00000100:00100000:2.0:1788970350.558877:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082244992:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.559023:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:6174:x1875871082244992:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 146us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.559038:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 341 00000100:00100000:2.0:1788970350.581983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970350.582147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245120 00000100:00100000:3.0:1788970350.582158:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245120 00000100:00100000:3.0:1788970350.582208:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 342 00000100:00100000:3.0:1788970350.582218:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:10788:x1875871082245120:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970350.582364:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:10788:x1875871082245120:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 146us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970350.582372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 342 00000100:00100000:1.0:1788970350.589283:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970350.589412:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245248 00000100:00100000:0.0:1788970350.589422:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245248 00000100:00100000:0.0:1788970350.589478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 343 00000100:00100000:0.0:1788970350.589487:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:10788:x1875871082245248:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788970350.589751:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:10788:x1875871082245248:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 264us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.589759:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 343 00010000:00010000:0.0:1788970350.620681:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788970350.620800:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970350.620804:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81ace000 from 7 10000000:01000000:3.0:1788970350.620809:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970350.620856:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.620868:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.620880:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970350.620906:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102251392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970350.620976:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970350.621092:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.622534:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251392 00000100:00100000:2.0:1788970350.622546:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251392 00000100:00100000:2.0:1788970350.622659:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788970350.622669:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:6521:x1875871102251392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970350.624779:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970350.624812:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6eb25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6eb1e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.624849:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6eb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb1e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.624860:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6eb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb1e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.624869:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98200, rc 0) 00000100:00100000:2.0:1788970350.625548:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102251392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2878us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.625558:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788970350.627262:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102251392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970350.627357:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.627370:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970350.627474:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102251520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970350.627523:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970350.627643:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653000 going to sleep for 11 seconds 00000100:00100000:1.0:1788970350.627690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251520 00000100:00100000:1.0:1788970350.627784:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251520 00000100:00100000:1.0:1788970350.627870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788970350.627880:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102251520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970350.628029:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102251520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970350.628037:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788970350.628105:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102251520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970350.628134:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102251648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970350.628179:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970350.632483:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.640471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251648 00000100:00100000:0.0:1788970350.640489:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251648 00000100:00100000:0.0:1788970350.640556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788970350.640577:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102251648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.640813:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102251648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (12633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.640822:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788970350.644156:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102251648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970350.645221:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13801:1875871102251776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970350.645293:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970350.645399:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.645446:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251776 00000100:00100000:0.0:1788970350.645452:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251776 00000100:00100000:0.0:1788970350.645525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788970350.645533:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:13801:x1875871102251776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970350.645661:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:13801:x1875871102251776:12345-0@lo:502:llog_process_th.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.645669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788970350.645746:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13801:1875871102251776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.645771:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.645780:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.645783:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.645789:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d81ace000 00000020:00000080:2.0:1788970350.645791:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970350.645850:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.645854:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.645855:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.645858:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.645860:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.645862:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788970350.645865:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d81ace000 00000020:00000080:2.0:1788970350.645867:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970350.650628:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13801:1875871102251904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.650703:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970350.656100:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102251904 00000100:00100000:1.0:1788970350.656116:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102251904 00000100:00100000:1.0:1788970350.656168:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788970350.656177:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:13801:x1875871102251904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970350.656231:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970350.656413:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:13801:x1875871102251904:12345-0@lo:502:llog_process_th.0 Request processed in 237us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970350.656421:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788970350.657088:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13801:1875871102251904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788970350.657142:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970350.657150:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970350.657152:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788970350.657158:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788970350.658317:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788970350.658353:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970350.658364:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970350.658376:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970350.658430:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970350.658432:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eaed7c000 from 7 10000000:01000000:1.0:1788970350.658435:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970350.658471:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970350.658479:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970350.658490:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970350.658512:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970350.658576:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970350.658614:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.658678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252032 00000100:00100000:0.0:1788970350.658685:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252032 00000100:00100000:0.0:1788970350.658730:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788970350.658738:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:6521:x1875871102252032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970350.658750:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970350.658763:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6eb33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6eb2c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.658785:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6eb33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb2c expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.658795:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6eb33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb2c expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.658804:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012c00, rc 0) 00000100:00100000:0.0:1788970350.658843:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102252032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.658849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788970350.658890:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970350.659056:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970350.659065:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970350.659143:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.659170:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970350.659185:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.659196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252160 00000100:00100000:0.0:1788970350.659200:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252160 00000100:00100000:0.0:1788970350.659217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788970350.659222:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102252160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.659319:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102252160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.659325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788970350.659354:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.659397:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.659434:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970350.659448:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.659459:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252288 00000100:00100000:0.0:1788970350.659462:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252288 00000100:00100000:0.0:1788970350.659479:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788970350.659485:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102252288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970350.659556:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102252288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.659574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788970350.659611:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.665797:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13804:1875871102252416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.665891:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.665955:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.666015:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252416 00000100:00100000:0.0:1788970350.666029:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252416 00000100:00100000:0.0:1788970350.666074:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788970350.666085:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:13804:x1875871102252416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970350.666222:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:13804:x1875871102252416:12345-0@lo:502:llog_process_th.0 Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.666230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788970350.666848:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13804:1875871102252416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.666887:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.666897:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.666899:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.666915:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7eaed7c000 00000020:00000080:2.0:1788970350.666918:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970350.666980:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.666984:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.666985:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.666988:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.666990:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.666991:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788970350.666994:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7eaed7c000 00000020:00000080:2.0:1788970350.666997:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970350.667034:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13804:1875871102252544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.667076:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.667098:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970350.667693:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252544 00000100:00100000:0.0:1788970350.667701:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252544 00000100:00100000:0.0:1788970350.667735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788970350.667742:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:13804:x1875871102252544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970350.667848:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:13804:x1875871102252544:12345-0@lo:502:llog_process_th.0 Request processed in 106us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970350.667856:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788970350.669043:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13804:1875871102252544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.669087:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.669094:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.669097:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788970350.669101:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788970350.669260:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788970350.669283:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970350.669293:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.669305:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970350.669316:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970350.669319:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebb899800 from 7 10000000:01000000:3.0:1788970350.669322:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970350.669354:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.669363:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970350.669373:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970350.669424:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970350.669476:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970350.669507:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.669755:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252672 00000100:00100000:2.0:1788970350.669762:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252672 00000100:00100000:2.0:1788970350.669804:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788970350.669813:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:6521:x1875871102252672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970350.669824:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970350.669836:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6eb41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6eb3a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.669858:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6eb41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb3a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.669870:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6eb41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb3a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.669893:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99c00, rc 0) 00000100:00100000:2.0:1788970350.669945:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102252672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.669952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788970350.669987:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970350.670000:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.670009:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970350.670059:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.670084:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.670096:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.670107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252800 00000100:00100000:2.0:1788970350.670110:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252800 00000100:00100000:2.0:1788970350.670125:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788970350.670131:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102252800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.670228:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102252800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.670235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788970350.670262:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.670293:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.670328:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.670349:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.670360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102252928 00000100:00100000:2.0:1788970350.670363:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102252928 00000100:00100000:2.0:1788970350.670403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788970350.670411:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102252928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.670483:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102252928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.670490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788970350.670525:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102252928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.670675:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13806:1875871102253056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.670706:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.670725:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253056 00000100:00100000:2.0:1788970350.670729:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253056 00000100:00100000:2.0:1788970350.670744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788970350.670749:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:13806:x1875871102253056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.670814:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:13806:x1875871102253056:12345-0@lo:502:llog_process_th.0 Request processed in 64us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.670821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788970350.670850:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.670860:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13806:1875871102253056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.670882:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.670889:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.670891:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.670896:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7ebb899800 00000020:00000080:2.0:1788970350.670898:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970350.670948:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.671246:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.671249:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.671253:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.671257:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.671258:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788970350.671262:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7ebb899800 00000020:00000080:2.0:1788970350.671264:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970350.671470:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13806:1875871102253184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.671506:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.671526:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253184 00000100:00100000:2.0:1788970350.671530:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253184 00000100:00100000:2.0:1788970350.671549:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788970350.671555:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:13806:x1875871102253184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.671633:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:13806:x1875871102253184:12345-0@lo:502:llog_process_th.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.671639:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788970350.671667:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.671680:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13806:1875871102253184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.671700:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.671704:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.671706:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788970350.671709:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788970350.671757:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788970350.671772:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970350.671779:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.671789:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970350.671809:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970350.671811:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0d2c000 from 7 10000000:01000000:2.0:1788970350.671814:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970350.671832:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.671840:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.671848:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970350.671861:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102253312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.671886:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.671899:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.671911:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253312 00000100:00100000:2.0:1788970350.671915:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253312 00000100:00100000:2.0:1788970350.671931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788970350.671936:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:6521:x1875871102253312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970350.671944:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970350.671953:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c6eb4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6eb48 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.671970:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c6eb4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb48 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.671979:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c6eb4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6eb48 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.671996:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98e00, rc 0) 00000100:00100000:2.0:1788970350.672025:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102253312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.672031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788970350.672058:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102253312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970350.672069:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970350.672078:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970350.672120:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102253440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.672144:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.672157:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.672168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253440 00000100:00100000:2.0:1788970350.672171:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253440 00000100:00100000:2.0:1788970350.672187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788970350.672193:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102253440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.672271:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102253440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.672277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788970350.672305:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102253440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.672330:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102253568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.672365:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.672408:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d834a90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970350.672419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253568 00000100:00100000:2.0:1788970350.672422:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253568 00000100:00100000:2.0:1788970350.672439:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788970350.672444:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102253568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970350.672507:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:6521:x1875871102253568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970350.672513:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788970350.672547:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5fe147a8-4210-48cf-8358-c541b06e4cd0:6521:1875871102253568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970350.673340:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788970350.677076:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13807:1875871102253696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.677151:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.677194:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d834a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970350.677244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253696 00000100:00100000:3.0:1788970350.677252:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253696 00000100:00100000:3.0:1788970350.677298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788970350.677307:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:13807:x1875871102253696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970350.677475:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:13807:x1875871102253696:12345-0@lo:502:llog_process_th.0 Request processed in 168us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970350.677489:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788970350.677633:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13807:1875871102253696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.677663:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.677672:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.677675:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.677681:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7eb0d2c000 00000020:00000080:2.0:1788970350.677684:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970350.677739:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.677742:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.677744:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970350.677746:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970350.677748:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.677750:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788970350.677753:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7eb0d2c000 00000020:00000080:2.0:1788970350.677755:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970350.677788:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13807:1875871102253824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970350.677821:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970350.677863:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d834a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970350.677902:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253824 00000100:00100000:1.0:1788970350.677916:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253824 00000100:00100000:1.0:1788970350.677949:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788970350.677957:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:13807:x1875871102253824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970350.678029:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:13807:x1875871102253824:12345-0@lo:502:llog_process_th.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970350.678036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788970350.678163:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5fe147a8-4210-48cf-8358-c541b06e4cd0:13807:1875871102253824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970350.678182:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970350.678186:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970350.678188:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788970350.678191:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788970350.678766:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788970350.678790:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970350.678799:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970350.678811:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970350.690736:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970351.392083:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970351.392108:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102253952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970351.392178:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970351.393420:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102253952 00000100:00100000:3.0:1788970351.393432:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102253952 00000100:00100000:3.0:1788970351.393563:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788970351.393575:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102253952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970351.393608:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970351.396515:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102253952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2933us (4327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970351.396529:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788970351.396692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102253952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970351.645842:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970351.709682:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788970351.710392:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788970352.412991:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102254336:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.413076:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970352.413127:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102254848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.413149:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970352.413171:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102255360:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.413190:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970352.413211:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788970352.413217:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102254208:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.413234:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970352.413250:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102254720:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413362:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254848 00000100:00100000:1.0:1788970352.413370:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254848 00000100:00100000:1.0:1788970352.413439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255360 00000100:00100000:1.0:1788970352.413443:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255360 00000100:00100000:1.0:1788970352.413461:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254208 00000100:00100000:1.0:1788970352.413463:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254208 00000100:00100000:1.0:1788970352.413479:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788970352.413488:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102254848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413536:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102254848:12345-0@lo:400:kworker.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.413544:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788970352.413573:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788970352.413580:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102255360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413607:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102255360:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.413613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788970352.413623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788970352.413628:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102254208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413651:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102254208:12345-0@lo:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.413656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1788970352.413683:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970352.413697:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102254080:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413727:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413747:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102254592:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413766:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413784:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102255104:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413803:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413818:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102255616:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413834:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413852:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788970352.413858:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102254464:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413877:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413892:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102254976:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413910:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102255488:0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.413940:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970352.413968:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255104 00000100:00100000:1.0:1788970352.413972:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255104 00000100:00100000:1.0:1788970352.414000:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255616 00000100:00100000:1.0:1788970352.414003:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255616 00000100:00100000:1.0:1788970352.414012:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254976 00000100:00100000:1.0:1788970352.414015:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254976 00000100:00100000:1.0:1788970352.414024:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255488 00000100:00100000:1.0:1788970352.414027:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255488 00000100:00100000:1.0:1788970352.414039:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970352.414044:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102255104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.414075:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102255104:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.414086:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970352.414099:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788970352.414104:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102255616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.414129:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102255616:12345-0@lo:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.414134:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788970352.414145:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788970352.414150:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102254976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.414174:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102254976:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.414179:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788970352.414190:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788970352.414195:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102255488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.414220:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102255488:12345-0@lo:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.414225:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788970352.414241:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970352.414244:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970352.414252:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254336 00000100:00100000:3.0:1788970352.414285:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254592 00000100:00100000:3.0:1788970352.414289:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254592 00000100:00100000:3.0:1788970352.414318:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970352.414325:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102254592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970352.414364:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102254592:12345-0@lo:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970352.414369:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970352.414400:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254464 00000100:00100000:3.0:1788970352.414403:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254464 00000100:00100000:3.0:1788970352.414426:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788970352.414431:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102254464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970352.414459:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102254464:12345-0@lo:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970352.414464:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788970352.414507:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102255744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970352.414540:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970352.414583:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255744 00000100:00100000:3.0:1788970352.414586:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255744 00000100:00100000:3.0:1788970352.414610:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788970352.414664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254080 00000100:00100000:2.0:1788970352.414668:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254080 00000100:00100000:2.0:1788970352.414695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788970352.414702:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970352.414740:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102254080:12345-0@lo:400:kworker.0 Request processed in 38us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970352.414745:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788970352.414800:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970352.414810:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102255872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970352.414837:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970352.414881:0:8444:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788970352.414889:0:8444:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788970352.414984:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255872 00000100:00100000:2.0:1788970352.414987:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255872 00000100:00100000:2.0:1788970352.415080:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788970352.415086:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102255872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970352.415107:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970352.415142:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102255872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970352.415148:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788970352.415178:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83593840 x1875871102255872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970352.415207:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102255872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970352.415414:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970352.415436:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415457:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788970352.415481:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf3752c0 x1875871102254848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970352.415491:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102254848:0@lo:400:kworker.0 00010000:00080000:0.0:1788970352.415502:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c64000 x1875871102255360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970352.415509:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102255360:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415527:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102254208:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415544:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102254720 00000100:00100000:0.0:1788970352.415547:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254720 00000100:00100000:0.0:1788970352.415584:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102255232 00000100:00100000:0.0:1788970352.415587:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102255232 00000100:00100000:0.0:1788970352.415600:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788970352.415605:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102254720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415639:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102254720:12345-0@lo:400:kworker.0 Request processed in 33us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970352.415644:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788970352.415655:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788970352.415660:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102255232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415683:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102255232:12345-0@lo:400:kworker.0 Request processed in 23us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970352.415688:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788970352.415818:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102254720:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415827:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415865:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102254464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415877:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102254976:0@lo:400:kworker.0 00010000:00080000:0.0:1788970352.415888:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c66580 x1875871102255488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970352.415897:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102255488:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415905:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102254080:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415914:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102254592:0@lo:400:kworker.0 00000100:00100000:0.0:1788970352.415924:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102255104:0@lo:400:kworker.0 00010000:00080000:0.0:1788970352.415935:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c652c0 x1875871102255616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970352.415944:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102255616:0@lo:400:kworker.0 00000100:00080000:0.0:1788970352.415980:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970352.418203:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102254336 00000100:00100000:1.0:1788970352.418281:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970352.418293:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102254336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970352.418408:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102254336:12345-0@lo:400:kworker.0 Request processed in 117us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970352.418415:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970352.418489:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102254336:0@lo:400:kworker.0 00000100:00100000:3.0:1788970352.419907:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102255744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970352.420214:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970352.420350:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102255744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5732us (5807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970352.420359:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1788970352.421030:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d835c6940 x1875871102255744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970352.421055:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102255744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788970352.669200:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970353.692555:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970353.948849:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102256000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970353.948918:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970353.949094:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256000 00000100:00100000:2.0:1788970353.949103:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256000 00000100:00100000:2.0:1788970353.949153:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970353.949162:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102256000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970353.949189:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970353.949197:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970353.949205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102256128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970353.949405:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102256000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970353.949415:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788970353.953351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970353.953470:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102256000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970353.953588:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256128 00000100:00100000:3.0:1788970353.953594:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256128 00000100:00100000:3.0:1788970353.953649:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788970353.953659:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102256128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970353.953681:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970353.953743:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102256128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970353.953750:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788970353.957360:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102256128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788970354.716620:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970354.885433:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970354.885481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970354.885517:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970354.885569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970354.885588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970354.885611:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970354.885642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245504 00000100:00100000:0.0:1788970354.885650:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245504 00000100:00100000:0.0:1788970354.885705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245632 00000100:00100000:0.0:1788970354.885708:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245632 00000100:00100000:0.0:1788970354.885722:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245888 00000100:00100000:0.0:1788970354.885725:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245888 00000100:00100000:0.0:1788970354.885737:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246016 00000100:00100000:0.0:1788970354.885740:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246016 00000100:00100000:0.0:1788970354.885755:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:0.0:1788970354.885764:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082245504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970354.885861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245376 00000100:00100000:2.0:1788970354.885867:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245376 00000100:00100000:2.0:1788970354.885897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 365 00000100:00100000:2.0:1788970354.885905:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082245376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970354.885979:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 221 00000100:00100000:1.0:1788970354.886002:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082245632:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970354.886116:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 222 00000100:00100000:3.0:1788970354.886126:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082245888:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970354.886709:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082245504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 942us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970354.886718:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:0.0:1788970354.886744:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 223 00000100:00100000:0.0:1788970354.886751:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082246016:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970354.888269:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082245376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 2354us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970354.888301:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 365 00000100:00080000:2.0:1788970354.888469:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970354.888475:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970354.888501:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082245760 00000100:00100000:2.0:1788970354.888509:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082245760 00000100:00100000:2.0:1788970354.888567:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:2.0:1788970354.888575:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082245760:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970354.888630:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082245760:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 56us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970354.888639:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00080000:2.0:1788970354.888655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970354.889079:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082245632:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 3089us (3558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970354.889089:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 221 00000100:00100000:3.0:1788970354.889470:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082245888:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 3344us (3877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970354.889480:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 222 00000100:00100000:0.0:1788970354.892066:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082246016:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 5303us (6441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970354.892080:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 223 00000100:00100000:1.0:1788970354.972968:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970354.972993:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83592580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102256256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970354.973072:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970354.973208:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256256 00000100:00100000:2.0:1788970354.973218:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256256 00000100:00100000:2.0:1788970354.973278:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788970354.973290:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102256256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970354.973329:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970354.973417:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102256256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970354.973425:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788970354.973616:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83592580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102256256:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788970355.493350:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1788970355.741652:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970356.508740:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102256384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970356.508840:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970356.509033:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256384 00000100:00100000:0.0:1788970356.509046:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256384 00000100:00100000:0.0:1788970356.509123:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788970356.509135:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102256384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970356.509540:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970356.509632:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102256384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 498us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970356.509640:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788970356.510374:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102256384:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788970356.766064:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970357.534064:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102256512:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.534082:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102256640:0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.534491:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102256768:0@lo:400:kworker.0 00000100:00100000:0.0:1788970357.535095:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102256896:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.537139:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.537234:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102257152:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.537276:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.537324:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102257664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.537348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.537370:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102258176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970357.537415:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.537443:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788970357.537450:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102257536:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.537475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.537496:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102258048:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.537530:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.537580:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256640 00000100:00100000:3.0:1788970357.537591:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256640 00000100:00100000:3.0:1788970357.537644:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257152 00000100:00100000:3.0:1788970357.537647:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257152 00000100:00100000:3.0:1788970357.537683:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257664 00000100:00100000:3.0:1788970357.537686:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257664 00000100:00100000:3.0:1788970357.537707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788970357.537716:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102256640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.537784:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102256640:12345-0@lo:400:kworker.0 Request processed in 68us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970357.537791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788970357.537811:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788970357.538760:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.538814:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102257152:12345-0@lo:400:kworker.0 Request processed in 979us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970357.538821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788970357.538856:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788970357.538864:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102257664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.538896:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102257664:12345-0@lo:400:kworker.0 Request processed in 33us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970357.538902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788970357.538928:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258176 00000100:00100000:3.0:1788970357.538934:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258176 00000100:00100000:1.0:1788970357.539003:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970357.539041:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256512 00000100:00100000:1.0:1788970357.539045:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256512 00000100:00100000:3.0:1788970357.539092:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788970357.539096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788970357.539105:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102258176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970357.539111:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102256512:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788970357.539138:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970357.539158:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102256512:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970357.539165:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788970357.539184:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102258176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970357.539193:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788970357.539221:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257536 00000100:00100000:3.0:1788970357.539226:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257536 00000100:00100000:3.0:1788970357.539261:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258048 00000100:00100000:1.0:1788970357.539263:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102256512:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.539264:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258048 00000100:00100000:1.0:1788970357.539281:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102257024:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.539289:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788970357.539298:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102257536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970357.539320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970357.539347:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102257536:12345-0@lo:400:kworker.0 Request processed in 49us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970357.539355:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788970357.539369:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788970357.539401:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257024 00000100:00100000:3.0:1788970357.539406:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102258048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970357.539408:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257024 00000100:00100000:1.0:1788970357.539450:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788970357.539451:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102258048:12345-0@lo:400:kworker.0 Request processed in 67us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970357.539463:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788970357.539463:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102257024:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788970357.539491:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970357.539496:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970357.539500:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970357.539581:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788970357.539588:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d836e70c0, transno 4294967301 00000100:00100000:3.0:1788970357.539602:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102257536:0@lo:400:kworker.0 00010000:00080000:3.0:1788970357.539618:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf376d00 x1875871102258048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970357.539631:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102258048:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.539643:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102257664:0@lo:400:kworker.0 00010000:00080000:3.0:1788970357.539654:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83593480 x1875871102258176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970357.539669:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102258176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970357.539682:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102256640:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.539693:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102257152:0@lo:400:kworker.0 00000100:00100000:1.0:1788970357.539970:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102257024:12345-0@lo:400:kworker.0 Request processed in 510us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970357.539978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788970357.540008:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102257024:0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.543132:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970357.543226:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102257280:0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.543283:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970357.543323:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102257792:0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.543347:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970357.543418:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257280 00000100:00100000:2.0:1788970357.543429:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257280 00000100:00100000:2.0:1788970357.543494:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257792 00000100:00100000:2.0:1788970357.543497:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257792 00000100:00100000:2.0:1788970357.543538:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788970357.543549:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83592580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102257280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970357.544579:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970357.544623:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102257408:0@lo:400:kworker.0 00000100:00100000:0.0:1788970357.544661:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970357.544684:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102257920:0@lo:400:kworker.0 00000100:00100000:0.0:1788970357.544707:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970357.544735:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970357.544744:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102258304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970357.544756:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83592580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102257280:12345-0@lo:400:kworker.0 Request processed in 1206us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970357.544787:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788970357.544817:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256896 00000100:00100000:2.0:1788970357.544823:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256896 00000100:00100000:2.0:1788970357.544847:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788970357.544855:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102257792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.544890:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102257792:12345-0@lo:400:kworker.0 Request processed in 37us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970357.544896:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788970357.544908:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788970357.544914:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102256896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.544939:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102256896:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970357.544945:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788970357.544967:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257408 00000100:00100000:0.0:1788970357.545024:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970357.545081:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102256896:0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.547478:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257408 00000100:00100000:2.0:1788970357.547603:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102257920 00000100:00100000:2.0:1788970357.547608:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102257920 00000100:00100000:2.0:1788970357.547650:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788970357.547663:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102257408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970357.547780:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788970357.547787:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102257408:12345-0@lo:400:kworker.0 Request processed in 125us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970357.547798:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1788970357.547860:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf3761c0 x1875871102257792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970357.547865:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102257920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970357.547883:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102257792:0@lo:400:kworker.0 00010000:00080000:2.0:1788970357.547921:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c66580 x1875871102257280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970357.547950:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102257280:0@lo:400:kworker.0 00000100:00100000:0.0:1788970357.547984:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102257920:12345-0@lo:400:kworker.0 Request processed in 193us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970357.547992:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788970357.548034:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102257408:0@lo:400:kworker.0 00010000:00080000:0.0:1788970357.548119:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf376580 x1875871102257920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970357.548136:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102257920:0@lo:400:kworker.0 00000100:00100000:3.0:1788970357.548616:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102256768 00000100:00100000:3.0:1788970357.548625:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102256768 00000100:00100000:3.0:1788970357.548678:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788970357.548686:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102256768:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788970357.548743:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970357.548751:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970357.548767:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102256768:12345-0@lo:400:kworker.0 Request processed in 81us (5646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970357.548782:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258304 00000100:00100000:3.0:1788970357.548783:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788970357.548787:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258304 00000100:00100000:2.0:1788970357.548815:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788970357.548823:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102258304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970357.548842:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970357.548945:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102258304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970357.548952:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788970357.549296:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102256768:0@lo:400:kworker.0 00010000:00080000:3.0:1788970357.551054:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377480 x1875871102258304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970357.551087:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102258304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788970357.790284:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970358.812810:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970359.068891:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102258432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970359.068983:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970359.069119:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258432 00000100:00100000:2.0:1788970359.069130:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258432 00000100:00100000:2.0:1788970359.069197:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788970359.069207:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102258432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970359.069241:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970359.069293:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102258432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970359.069301:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788970359.069368:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970359.069438:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102258432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970359.069808:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970359.069819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102258560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970359.069852:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970359.070000:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258560 00000100:00100000:1.0:1788970359.070005:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258560 00000100:00100000:1.0:1788970359.070052:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788970359.070060:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102258560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970359.070072:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970359.070112:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102258560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970359.070119:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788970359.070166:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970359.070214:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102258560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788970359.836831:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970360.007359:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970360.007471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970360.007515:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970360.007560:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970360.007582:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970360.007605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970360.007636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246144 00000100:00100000:2.0:1788970360.007671:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246144 00000100:00100000:2.0:1788970360.007739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 367 00000100:00100000:2.0:1788970360.007751:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082246144:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970360.007852:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e82e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082246144:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970360.007862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 367 00000100:00100000:2.0:1788970360.007909:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246272 00000100:00100000:2.0:1788970360.007913:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246272 00000100:00100000:2.0:1788970360.007956:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246784 00000100:00100000:2.0:1788970360.007959:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246784 00000100:00100000:2.0:1788970360.007976:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246400 00000100:00100000:2.0:1788970360.007979:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246400 00000100:00100000:2.0:1788970360.007995:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246656 00000100:00100000:2.0:1788970360.007998:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246656 00000100:00100000:2.0:1788970360.008014:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:2.0:1788970360.008020:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83593c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082246272:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970360.008052:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83593c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082246272:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970360.008070:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:3.0:1788970360.008184:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246528 00000100:00100000:3.0:1788970360.008189:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246528 00000100:00100000:3.0:1788970360.008228:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:3.0:1788970360.008236:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082246528:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970360.008268:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082246528:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970360.008275:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00080000:3.0:1788970360.008299:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970360.008304:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970360.008306:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970360.008517:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:3.0:1788970360.008525:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082246784:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970360.008570:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082246784:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 46us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970360.008577:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:3.0:1788970360.008592:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:3.0:1788970360.008598:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082246400:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970360.008617:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082246400:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 19us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970360.008623:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:3.0:1788970360.008632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:3.0:1788970360.008637:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082246656:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970360.008654:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082246656:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 17us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970360.008660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:0.0:1788970360.092892:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102258688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970360.092998:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970360.093265:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258688 00000100:00100000:1.0:1788970360.093277:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258688 00000100:00100000:1.0:1788970360.093349:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788970360.093360:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102258688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970360.093441:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788970360.093873:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102258688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 513us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970360.093881:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788970360.093967:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102258688:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788970360.860670:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970361.628774:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970361.628800:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102258816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970361.628874:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970361.628992:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258816 00000100:00100000:3.0:1788970361.629000:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258816 00000100:00100000:3.0:1788970361.629052:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788970361.629060:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102258816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970361.629090:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970361.629132:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102258816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970361.629138:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788970361.629212:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102258816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970361.884871:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970361.949066:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788970361.949896:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970362.653110:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970362.653133:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102258944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970362.653214:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970362.653285:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102258944 00000100:00100000:1.0:1788970362.653292:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102258944 00000100:00100000:1.0:1788970362.653346:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788970362.653355:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102258944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970362.653409:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970362.653453:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102258944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970362.653460:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788970362.653501:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788970362.653531:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58dd2c0 x1875871102258944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970362.653550:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102258944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970362.653798:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8335a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102259072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970362.653834:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970362.654009:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259072 00000100:00100000:0.0:1788970362.654014:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259072 00000100:00100000:0.0:1788970362.654056:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788970362.654064:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102259072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970362.654077:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970362.654115:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102259072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970362.654121:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1788970362.654149:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8335a1c0 x1875871102259072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970362.654161:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8335a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102259072:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788970362.654220:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970362.655179:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102259456:0@lo:400:kworker.0 00000100:00100000:1.0:1788970362.655221:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970362.655254:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102259968:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.655369:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102259328:0@lo:400:kworker.0 00000100:00100000:3.0:1788970362.655502:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102259584:0@lo:400:kworker.0 00000100:00100000:0.0:1788970362.655616:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102259200:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658112:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970362.658172:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658227:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970362.658408:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102260352:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658435:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970362.658493:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259328 00000100:00100000:2.0:1788970362.658501:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259328 00000100:00100000:2.0:1788970362.658545:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259840 00000100:00100000:2.0:1788970362.658548:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259840 00000100:00100000:2.0:1788970362.658582:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260352 00000100:00100000:2.0:1788970362.658585:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260352 00000100:00100000:2.0:1788970362.658602:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788970362.658610:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102259328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658800:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102259328:12345-0@lo:400:kworker.0 Request processed in 190us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970362.658808:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788970362.658827:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788970362.658833:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102259840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658862:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102259840:12345-0@lo:400:kworker.0 Request processed in 30us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970362.658867:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788970362.658878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788970362.658884:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102260352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658907:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102260352:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970362.658913:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788970362.658985:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102259328:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.658995:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.659014:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102260352:0@lo:400:kworker.0 00000100:00080000:2.0:1788970362.659052:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970362.659071:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259456 00000100:00100000:2.0:1788970362.659074:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259456 00000100:00100000:2.0:1788970362.659101:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788970362.659107:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102259456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.659143:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102259456:12345-0@lo:400:kworker.0 Request processed in 36us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970362.659147:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788970362.659874:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970362.659933:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102260480:0@lo:400:kworker.0 00000100:00100000:1.0:1788970362.659967:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970362.659992:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259968 00000100:00100000:1.0:1788970362.660006:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259968 00000100:00100000:1.0:1788970362.660040:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260480 00000100:00100000:1.0:1788970362.660043:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260480 00000100:00100000:1.0:1788970362.660063:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788970362.660069:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102259968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970362.660105:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102259968:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970362.660111:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788970362.660123:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788970362.660128:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102260480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970362.660151:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102260480:12345-0@lo:400:kworker.0 Request processed in 24us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970362.660156:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:1.0:1788970362.660174:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788970362.660194:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7e898fd680 x1875871102260480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970362.660205:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102260480:0@lo:400:kworker.0 00000100:00100000:1.0:1788970362.660228:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102259456:0@lo:400:kworker.0 00010000:00080000:1.0:1788970362.660251:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef2a940 x1875871102259968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970362.660259:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102259968:0@lo:400:kworker.0 00000100:00100000:3.0:1788970362.661164:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970362.661206:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102260096:0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.661356:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259584 00000100:00100000:2.0:1788970362.661362:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259584 00000100:00100000:2.0:1788970362.661407:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788970362.661414:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102259584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.661452:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102259584:12345-0@lo:400:kworker.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970362.661457:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788970362.661573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970362.661739:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102259584:0@lo:400:kworker.0 00000100:00100000:0.0:1788970362.661823:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970362.661859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102259712:0@lo:400:kworker.0 00000100:00100000:0.0:1788970362.661886:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970362.661917:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102260224:0@lo:400:kworker.0 00000100:00100000:0.0:1788970362.661945:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970362.661982:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259712 00000100:00100000:3.0:1788970362.661986:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259712 00000100:00100000:3.0:1788970362.662016:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788970362.662022:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102259712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970362.662063:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102259712:12345-0@lo:400:kworker.0 Request processed in 41us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970362.662069:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788970362.663811:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102259200 00000100:00100000:2.0:1788970362.663824:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102259200 00000100:00100000:2.0:1788970362.663886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788970362.663901:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102259200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970362.663976:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102259200:12345-0@lo:400:kworker.0 Request processed in 83us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970362.663982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788970362.666567:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260096 00000100:00100000:0.0:1788970362.666589:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788970362.666627:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102259712:0@lo:400:kworker.0 00000100:00100000:1.0:1788970362.666631:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260096 00000100:00100000:1.0:1788970362.666701:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260224 00000100:00100000:1.0:1788970362.666705:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260224 00000100:00100000:1.0:1788970362.666731:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788970362.666746:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102260096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970362.666888:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788970362.666909:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102260224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970362.667052:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102260224:12345-0@lo:400:kworker.0 Request processed in 154us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970362.667060:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788970362.668468:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102260096:12345-0@lo:400:kworker.0 Request processed in 1717us (6887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970362.668489:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788970362.668815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102260096:0@lo:400:kworker.0 00000100:00100000:0.0:1788970362.669737:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102260224:0@lo:400:kworker.0 00000100:00080000:2.0:1788970362.670771:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788970362.912707:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970363.933722:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970364.188870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102260608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970364.188944:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970364.189096:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260608 00000100:00100000:1.0:1788970364.189109:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260608 00000100:00100000:0.0:1788970364.189181:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102260736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970364.189260:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970364.189352:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260736 00000100:00100000:2.0:1788970364.189359:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260736 00000100:00100000:1.0:1788970364.189437:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788970364.189701:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970364.195719:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102260608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970364.195789:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970364.195922:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102260608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6474us (6977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970364.195933:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788970364.196515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102260608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970364.199755:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788970364.199796:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102260736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970364.199839:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970364.199991:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102260736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (10730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970364.200141:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788970364.200281:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102260736:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788970364.956680:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970365.126199:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970365.126302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970365.126341:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970365.126420:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247168 00000100:00100000:3.0:1788970365.126430:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247168 00000100:00100000:3.0:1788970365.126501:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247040 00000100:00100000:3.0:1788970365.126505:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247040 00000100:00100000:3.0:1788970365.126547:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 240 00000100:00100000:3.0:1788970365.126558:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082247168:12345-192.168.203.15@tcp:400:kworker.0 00000100:00080000:2.0:1788970365.126759:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970365.126763:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970365.126777:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 241 00000100:00100000:2.0:1788970365.126786:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082247040:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970365.126841:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082247040:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 56us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970365.126848:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 241 00000100:00100000:3.0:1788970365.127166:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082247168:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 609us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970365.127174:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 240 00000100:00100000:1.0:1788970365.129114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082246912 00000100:00100000:1.0:1788970365.129127:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082246912 00000100:00100000:1.0:1788970365.129809:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 369 00000100:00100000:1.0:1788970365.129822:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082246912:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970365.129902:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082246912:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 82us (3713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970365.129909:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 369 00000100:00100000:2.0:1788970365.142822:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970365.142983:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247424 00000100:00100000:1.0:1788970365.142993:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247424 00000100:00100000:1.0:1788970365.143319:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 242 00000100:00100000:1.0:1788970365.143330:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082247424:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970365.143448:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082247424:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 119us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970365.143455:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 242 00000100:00080000:2.0:1788970365.144653:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970365.147503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970365.147797:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247552 00000100:00100000:2.0:1788970365.147807:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247552 00000100:00100000:2.0:1788970365.147885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 243 00000100:00100000:2.0:1788970365.147895:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082247552:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970365.147992:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082247552:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 98us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970365.147999:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 243 00000100:00080000:3.0:1788970365.148738:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970365.153873:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970365.154266:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247296 00000100:00100000:3.0:1788970365.154276:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247296 00000100:00080000:2.0:1788970365.154530:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970365.154602:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:3.0:1788970365.154615:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d833583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2399:x1875871082247296:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:3.0:1788970365.154648:0:8689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6ea76 00000100:00080000:3.0:1788970365.154658:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3ea000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970365.154701:0:8689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788970365.154854:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d833583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+2:2399:x1875871082247296:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 241us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970365.154861:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00010000:00010000:2.0:1788970365.154918:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970365.212707:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970365.212732:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102260864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970365.212807:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970365.212989:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260864 00000100:00100000:2.0:1788970365.212998:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260864 00000100:00100000:2.0:1788970365.213047:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788970365.213058:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102260864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970365.213092:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970365.213153:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102260864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970365.213160:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788970365.213777:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102260864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788970365.982651:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970366.749119:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970366.749144:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102260992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970366.749230:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970366.749606:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102260992 00000100:00100000:2.0:1788970366.749615:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102260992 00000100:00100000:2.0:1788970366.749665:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788970366.749673:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102260992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970366.749895:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970366.749954:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102260992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 281us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970366.749965:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788970366.750180:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102260992:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788970367.004547:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970367.773190:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102261504:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773251:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.773308:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102262016:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773335:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.773360:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102262528:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773414:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.773451:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788970367.773458:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773497:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.773516:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102261888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773536:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.773550:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102262400:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773569:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.773597:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261504 00000100:00100000:3.0:1788970367.773604:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261504 00000100:00100000:3.0:1788970367.773645:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788970367.773654:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102261504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773707:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102261504:12345-0@lo:400:kworker.0 Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.773714:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788970367.773734:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262016 00000100:00100000:3.0:1788970367.773737:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262016 00000100:00100000:3.0:1788970367.773771:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262528 00000100:00100000:3.0:1788970367.773774:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262528 00000100:00100000:3.0:1788970367.773784:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261376 00000100:00100000:3.0:1788970367.773786:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261376 00000100:00100000:3.0:1788970367.773795:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261888 00000100:00100000:3.0:1788970367.773797:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261888 00000100:00100000:3.0:1788970367.773806:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262400 00000100:00100000:3.0:1788970367.773808:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262400 00000100:00100000:3.0:1788970367.773818:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788970367.773824:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102262016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773851:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102262016:12345-0@lo:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.773857:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788970367.773867:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788970367.773879:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102262528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773904:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102262528:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.773909:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788970367.773919:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788970367.773923:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaee403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102261376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773940:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaee403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102261376:12345-0@lo:400:kworker.0 Request processed in 18us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.773945:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788970367.773953:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788970367.773958:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102261888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.773978:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102261888:12345-0@lo:400:kworker.0 Request processed in 20us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.773983:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788970367.774113:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788970367.774120:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102262400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774147:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102262400:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.774152:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788970367.774200:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774209:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102261888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774215:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102262400:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774223:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102261504:0@lo:400:kworker.0 00010000:00080000:3.0:1788970367.774242:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8338a1c0 x1875871102262016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970367.774253:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102262016:0@lo:400:kworker.0 00010000:00080000:3.0:1788970367.774263:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c783c0 x1875871102262528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970367.774272:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102261248:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774273:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102262528:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774317:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.774343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261248 00000100:00100000:3.0:1788970367.774347:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261248 00000100:00100000:1.0:1788970367.774352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102261760:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774375:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788970367.774400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.774406:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102262272:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774458:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102261248:12345-0@lo:400:kworker.0 Request processed in 75us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.774469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788970367.774473:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970367.774500:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102262784:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774511:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262272 00000100:00100000:3.0:1788970367.774516:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262272 00000100:00100000:1.0:1788970367.774527:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.774551:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262784 00000100:00100000:3.0:1788970367.774554:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262784 00000100:00100000:1.0:1788970367.774562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102261248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774575:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788970367.774578:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788970367.774586:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102261120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970367.774589:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102262272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774619:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970367.774644:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102261632:0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774648:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102262272:12345-0@lo:400:kworker.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.774656:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788970367.774670:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788970367.774676:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102262784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970367.774704:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102262784:12345-0@lo:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.774718:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788970367.774744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970367.774767:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102262144:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774798:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970367.774818:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102262656:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774836:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970367.774859:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102262272:0@lo:400:kworker.0 00010000:00080000:1.0:1788970367.774868:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7bc00 x1875871102262784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970367.774882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102262784:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.774907:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262144 00000100:00100000:1.0:1788970367.774911:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262144 00000100:00080000:2.0:1788970367.774928:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970367.774932:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262656 00000100:00080000:2.0:1788970367.774934:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970367.774935:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262656 00000100:00080000:2.0:1788970367.774938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970367.774941:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970367.774944:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970367.774956:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788970367.774957:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261760 00000100:00100000:2.0:1788970367.774964:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261760 00000100:00100000:1.0:1788970367.774964:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102262144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.775005:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102262144:12345-0@lo:400:kworker.0 Request processed in 42us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970367.775011:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788970367.775014:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788970367.775023:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102261760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.775032:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970367.775040:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102262656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970367.775071:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102261760:12345-0@lo:400:kworker.0 Request processed in 50us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970367.775079:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102262656:12345-0@lo:400:kworker.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970367.775091:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788970367.775095:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788970367.775127:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261632 00000100:00100000:2.0:1788970367.775132:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261632 00000100:00100000:1.0:1788970367.775140:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102261120 00000100:00100000:1.0:1788970367.775146:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102261120 00000100:00100000:2.0:1788970367.775159:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788970367.775168:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102261632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.775175:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788970367.775204:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102261632:12345-0@lo:400:kworker.0 Request processed in 38us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970367.775210:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788970367.775262:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102261120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970367.775292:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970367.775325:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102261120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970367.775331:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788970367.775358:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7fc00 x1875871102261120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970367.775373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102261120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970367.775401:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102261632:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.775413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102262144:0@lo:400:kworker.0 00010000:00080000:1.0:1788970367.775422:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c78f00 x1875871102262656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970367.775431:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102262656:0@lo:400:kworker.0 00000100:00100000:1.0:1788970367.775453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102261760:0@lo:400:kworker.0 00000100:00100000:0.0:1788970367.779464:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970367.779488:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8276d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102262912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970367.779556:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970367.779876:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102262912 00000100:00100000:3.0:1788970367.779884:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102262912 00000100:00100000:3.0:1788970367.779941:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788970367.779950:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102262912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970367.779973:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970367.780030:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102262912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970367.780037:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1788970367.780112:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8276d680 x1875871102262912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970367.780130:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8276d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102262912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788970368.028625:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970369.052544:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970369.309123:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970369.309145:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102263040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970369.309213:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970369.309340:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263040 00000100:00100000:2.0:1788970369.309348:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263040 00000100:00100000:2.0:1788970369.309439:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788970369.309450:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102263040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970369.309478:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970369.309539:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102263040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970369.309546:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788970369.309591:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102263040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788970369.309850:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970369.309966:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102263168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970369.310000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970369.310090:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263168 00000100:00100000:2.0:1788970369.310095:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263168 00000100:00100000:2.0:1788970369.310139:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788970369.310147:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102263168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970369.310161:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970369.310193:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102263168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970369.310199:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788970369.310284:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102263168:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788970369.310340:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788970370.076629:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970370.246894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970370.246937:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970370.246969:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970370.247006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970370.247027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970370.247104:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247680 00000100:00100000:1.0:1788970370.247115:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247680 00000100:00100000:1.0:1788970370.247173:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 371 00000100:00100000:1.0:1788970370.247184:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082247680:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970370.247252:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082247680:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 69us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970370.247272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 371 00000100:00100000:1.0:1788970370.247319:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247936 00000100:00100000:1.0:1788970370.247322:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247936 00000100:00100000:1.0:1788970370.247356:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248192 00000100:00100000:1.0:1788970370.247358:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248192 00000100:00100000:1.0:1788970370.247371:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082247808 00000100:00100000:1.0:1788970370.247373:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082247808 00000100:00100000:1.0:1788970370.247433:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248064 00000100:00100000:1.0:1788970370.247437:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248064 00000100:00100000:1.0:1788970370.247453:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:1.0:1788970370.247459:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082247936:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970370.247489:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082247936:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970370.247495:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:1.0:1788970370.247507:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:1.0:1788970370.247514:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb595b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082248192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970370.247664:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb595b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082248192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 149us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970370.247671:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:1.0:1788970370.247684:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:1.0:1788970370.247690:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8254a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082247808:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970370.247725:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8254a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082247808:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970370.247731:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:1.0:1788970370.247743:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00100000:1.0:1788970370.247757:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082248064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970370.247785:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082248064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970370.247791:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00080000:1.0:1788970370.247922:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970370.247927:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970370.335637:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970370.335661:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102263296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970370.336103:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970370.338679:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263296 00000100:00100000:2.0:1788970370.338694:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263296 00000100:00100000:2.0:1788970370.338752:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788970370.338762:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102263296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970370.338800:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788970370.338885:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102263296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970370.338892:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788970370.338945:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102263296:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788970370.858599:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:2.0:1788970370.858610:0:8435:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3e9800/76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:1.0:1788970370.858681:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3e9800/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-OST0000 00000020:00000080:1.0:1788970370.858731:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3ea000 for lustre-OST0000 00010000:00010000:0.0:1788970371.101482:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970371.166209:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788970371.167922:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788970371.869261:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102263424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970371.869354:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970371.869474:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263424 00000100:00100000:3.0:1788970371.869482:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263424 00000100:00100000:3.0:1788970371.869532:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788970371.869541:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102263424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970371.869572:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970371.869622:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102263424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970371.869629:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788970371.869680:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8338a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102263424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788970372.131960:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970372.892590:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970372.892614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102263552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970372.892680:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970372.892719:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102263808:0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.892726:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102263936:0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.892753:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970372.892775:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970372.892777:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102264448:0@lo:400:kworker.0 00000100:00100000:1.0:1788970372.892803:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102264320:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.892808:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102264064:0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.892812:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970372.892844:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263808 00000100:00100000:0.0:1788970372.892846:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970372.892852:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263808 00000100:00100000:3.0:1788970372.892856:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102264960:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.892873:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102264576:0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.892888:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970372.892904:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264448 00000100:00100000:0.0:1788970372.892905:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970372.892907:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264448 00000100:00100000:0.0:1788970372.892932:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102265088:0@lo:400:kworker.0 00000100:00100000:1.0:1788970372.892935:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264064 00000100:00100000:1.0:1788970372.892938:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264064 00000100:00100000:3.0:1788970372.892943:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263552 00000100:00100000:3.0:1788970372.892949:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263552 00000100:00100000:1.0:1788970372.892952:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264960 00000100:00100000:1.0:1788970372.892966:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264960 00000100:00100000:3.0:1788970372.892985:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788970372.892995:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788970372.892997:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102263552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970372.893008:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5825680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102263808:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788970372.893026:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970372.893075:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102263552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.893081:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788970372.893100:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263936 00000100:00100000:3.0:1788970372.893103:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263936 00000100:00100000:3.0:1788970372.893122:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788970372.893126:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102263936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.893154:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102263936:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.893159:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788970372.893189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788970372.893196:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.893268:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102264448:12345-0@lo:400:kworker.0 Request processed in 72us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.893274:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788970372.893289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788970372.893295:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102264064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.893323:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102264064:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.893329:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788970372.893341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788970372.893346:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102264960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.893373:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102264960:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.893378:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788970372.893444:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970372.893665:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102263680:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.893675:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970372.893699:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970372.893722:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102264192:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.893736:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102264064:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.893743:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970372.893759:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102264704:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.893759:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264576 00000100:00100000:0.0:1788970372.893763:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264576 00000100:00100000:2.0:1788970372.893777:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970372.893793:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265088 00000100:00100000:2.0:1788970372.893794:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102265216:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.893796:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265088 00000100:00100000:0.0:1788970372.893810:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264704 00000100:00100000:0.0:1788970372.893812:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264704 00000100:00100000:2.0:1788970372.893813:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970372.893823:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265216 00000100:00100000:2.0:1788970372.893825:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970372.893825:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265216 00000100:00100000:2.0:1788970372.893830:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102265344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970372.893838:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788970372.893843:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102264576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.893848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970372.893879:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102264576:12345-0@lo:400:kworker.0 Request processed in 34us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970372.893885:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788970372.893902:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788970372.893907:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102265088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.893933:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102265088:12345-0@lo:400:kworker.0 Request processed in 26us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970372.893948:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788970372.893963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102264832:0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.893991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970372.894023:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102263808:0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.894096:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788970372.894104:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102264704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970372.894192:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102264704:12345-0@lo:400:kworker.0 Request processed in 89us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970372.894200:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5825680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102263808:12345-0@lo:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970372.894207:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788970372.894249:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788970372.894253:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264320 00000100:00100000:3.0:1788970372.894259:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264320 00000100:00100000:0.0:1788970372.894267:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788970372.894276:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102265216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.894287:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264832 00000100:00100000:3.0:1788970372.894291:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264832 00000100:00100000:1.0:1788970372.894293:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788970372.894311:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102265216:12345-0@lo:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.894317:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788970372.894322:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970372.894329:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102264832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970372.894368:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102264320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.894373:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102264832:12345-0@lo:400:kworker.0 Request processed in 46us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970372.894423:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788970372.894501:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102264320:12345-0@lo:400:kworker.0 Request processed in 200us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970372.894507:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1788970372.894524:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970372.894529:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970372.894531:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970372.894533:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970372.894583:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102264576:0@lo:400:kworker.0 00010000:00080000:0.0:1788970372.894596:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaeef2940 x1875871102265088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970372.894607:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.894610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102263680 00000100:00100000:2.0:1788970372.894614:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102263680 00000100:00100000:2.0:1788970372.894638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788970372.894656:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102263680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.894688:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102263680:12345-0@lo:400:kworker.0 Request processed in 38us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970372.894725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788970372.894755:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102264192 00000100:00100000:2.0:1788970372.894759:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102264192 00000100:00100000:2.0:1788970372.894789:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788970372.894793:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970372.894821:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102264320:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.894826:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102264192:12345-0@lo:400:kworker.0 Request processed in 31us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970372.894831:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788970372.894840:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102264832:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.894851:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265344 00000100:00100000:2.0:1788970372.894854:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265344 00000100:00100000:3.0:1788970372.894879:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102263936:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.894884:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788970372.894893:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaeef3840 x1875871102264448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970372.894901:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102265344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970372.894910:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102264448:0@lo:400:kworker.0 00002000:00000024:2.0:1788970372.894919:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788970372.894922:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaeef0000 x1875871102264960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970372.894931:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102264960:0@lo:400:kworker.0 00010000:00080000:3.0:1788970372.894942:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7e8949d2c0 x1875871102263552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970372.894954:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102263552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970372.895007:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102265344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970372.895014:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788970372.895043:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83c7b0c0 x1875871102265344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970372.895068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102265344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970372.895080:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102263680:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.895088:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102264192:0@lo:400:kworker.0 00000100:00100000:2.0:1788970372.895097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102264704:0@lo:400:kworker.0 00010000:00080000:2.0:1788970372.895116:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb58261c0 x1875871102265216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970372.895125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb58261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102265216:0@lo:400:kworker.0 00010000:00010000:0.0:1788970373.150161:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970374.172863:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970374.429320:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5826580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102265600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970374.429412:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970374.429486:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970374.429493:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102265472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970374.429515:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970374.429578:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265600 00000100:00100000:1.0:1788970374.429586:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265600 00000100:00100000:1.0:1788970374.429652:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265472 00000100:00100000:1.0:1788970374.429656:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265472 00000100:00100000:1.0:1788970374.429676:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788970374.429685:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102265600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970374.429711:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970374.429759:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102265600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970374.429766:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788970374.429781:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788970374.429787:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102265472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970374.429796:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970374.429817:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102265472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970374.429822:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788970374.429864:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102265472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970374.429874:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5826580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102265600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788970374.430189:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788970375.198558:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970375.362201:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970375.362259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970375.362288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970375.362321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970375.362343:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970375.362474:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248576 00000100:00100000:2.0:1788970375.362484:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248576 00000100:00100000:2.0:1788970375.362637:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248832 00000100:00100000:2.0:1788970375.362641:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248832 00000100:00100000:2.0:1788970375.362659:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248448 00000100:00100000:2.0:1788970375.362662:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248448 00000100:00100000:2.0:1788970375.362674:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248704 00000100:00100000:2.0:1788970375.362676:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248704 00000100:00100000:2.0:1788970375.362692:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00100000:2.0:1788970375.362700:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082248576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970375.362771:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082248576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 71us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970375.362779:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00100000:2.0:1788970375.362797:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 261 00000100:00100000:2.0:1788970375.362804:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5824780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082248832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970375.362828:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5824780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082248832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970375.362833:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 261 00000100:00100000:2.0:1788970375.362843:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 262 00000100:00100000:2.0:1788970375.362849:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5826d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082248448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970375.362872:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5826d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082248448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970375.362887:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 262 00000100:00100000:2.0:1788970375.362900:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 263 00000100:00100000:2.0:1788970375.362906:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb58261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082248704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970375.362928:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb58261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082248704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970375.362933:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 263 00000100:00080000:1.0:1788970375.363132:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970375.363136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970375.363191:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248320 00000100:00100000:0.0:1788970375.363201:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248320 00000100:00100000:0.0:1788970375.363235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 373 00000100:00100000:0.0:1788970375.363242:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082248320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970375.363267:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082248320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970375.363273:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 373 00000100:00100000:3.0:1788970375.462664:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970375.462687:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102265728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970375.462762:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970375.462821:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265728 00000100:00100000:3.0:1788970375.462828:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265728 00000100:00100000:3.0:1788970375.462870:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788970375.462878:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8338a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102265728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970375.462911:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788970375.462954:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8338a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102265728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970375.462966:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788970375.463022:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102265728:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788970375.576881:0:14069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:12:54 (1788970374) 00010000:00010000:1.0:1788970376.221113:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970376.988788:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102265856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970376.988860:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970376.989001:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265856 00000100:00100000:3.0:1788970376.989010:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265856 00000100:00100000:3.0:1788970376.989064:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788970376.989073:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102265856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970376.989104:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788970376.989176:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102265856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970376.989183:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788970376.989252:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102265856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970377.136869:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970377.137088:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082248960 00000100:00100000:2.0:1788970377.137100:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082248960 00000100:00100000:2.0:1788970377.137199:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1788970377.137213:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:11079:x1875871082248960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970377.137235:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970377.137260:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d75f expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.137327:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6eb5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.137344:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.137358:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970377.137461:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970377.137465:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970377.137504:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.137550:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d75f expref: 7 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.137570:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6eb5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d75f expref: 6 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.137579:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e6600) 00010000:00010000:2.0:1788970377.137582:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970377.137585:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98a00, rc 0) 00000100:00100000:2.0:1788970377.137656:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:11079:x1875871082248960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 449us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970377.137663:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00080000:1.0:1788970377.137796:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970377.154124:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970377.154279:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082249088 00000100:00100000:0.0:1788970377.154290:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082249088 00000100:00100000:0.0:1788970377.154350:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:0.0:1788970377.154362:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:11080:x1875871082249088:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970377.154436:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970377.154458:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eb64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d766 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154521:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154537:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154549:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154564:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154585:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154592:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154656:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6eb79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154665:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6eb79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154673:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6eb79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970377.154714:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970377.154717:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970377.154737:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6eb79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154748:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154755:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154761:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154767:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970377.154772:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154786:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154800:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e6600) 00010000:00010000:0.0:1788970377.154802:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970377.154807:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154813:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eb6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154827:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154833:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154839:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154844:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970377.154847:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154853:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154860:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a7d83360d00) 00010000:00010000:0.0:1788970377.154862:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970377.154865:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154881:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eb72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154915:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eb64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d766 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154927:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6eb79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d766 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970377.154933:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7d83360700) 00010000:00010000:0.0:1788970377.154935:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970377.154937:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012000, rc 0) 00000100:00100000:0.0:1788970377.155005:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11080:x1875871082249088:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 646us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970377.155013:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:0.0:1788970377.162828:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970377.162959:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082249216 00000100:00100000:3.0:1788970377.162972:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082249216 00000100:00100000:3.0:1788970377.163047:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1788970377.163058:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11080:x1875871082249216:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788970377.166084:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11080:x1875871082249216:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 Request processed in 3016us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970377.166101:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:1.0:1788970377.180674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970377.186442:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082249472 00000100:00100000:2.0:1788970377.186456:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082249472 00000100:00100000:2.0:1788970377.186679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:2.0:1788970377.186691:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11080:x1875871082249472:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970377.186712:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970377.186733:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6eb80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d76d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.186809:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.186824:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.186853:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.196616:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.196644:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.196659:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.196805:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6eb95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.196814:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6eb95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.196821:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6eb95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970377.196833:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788970377.196927:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200050:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200059:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200066:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970377.200088:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200097:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200116:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7d83360700) 00010000:00010000:2.0:1788970377.200119:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970377.200123:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200130:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6eb87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200148:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200154:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200159:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200165:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970377.200168:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200173:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200179:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a7d823e6100) 00010000:00010000:2.0:1788970377.200181:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970377.200188:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200194:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eb8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200537:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6eb80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d76d expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200553:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6eb95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d76d expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970377.200560:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:2.0:1788970377.200563:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970377.200565:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98600, rc 0) 00000100:00100000:2.0:1788970377.200642:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11080:x1875871082249472:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 13952us (19975us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788970377.200652:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:3.0:1788970377.210150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970377.210230:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082249600 00000100:00100000:2.0:1788970377.210240:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082249600 00000100:00100000:2.0:1788970377.210303:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:2.0:1788970377.210315:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11080:x1875871082249600:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788970377.210470:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11080:x1875871082249600:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970377.210477:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:0.0:1788970377.214591:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970377.214675:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082249728 00000100:00100000:3.0:1788970377.214685:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082249728 00000100:00100000:3.0:1788970377.214759:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1788970377.214770:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:11080:x1875871082249728:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788970377.216513:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788970377.217022:0:13652:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1873us 00000100:00100000:2.0:1788970377.232663:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:11080:x1875871082249728:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 17885us (18070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970377.232694:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00010000:00010000:0.0:1788970377.244570:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970377.309101:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788970377.311040:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970378.013578:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8367ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102265984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970378.013653:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970378.013731:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102265984 00000100:00100000:1.0:1788970378.013739:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102265984 00000100:00100000:1.0:1788970378.013787:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788970378.013797:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102265984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970378.013826:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970378.013867:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102265984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970378.013873:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1788970378.013914:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8367ad00 x1875871102265984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970378.013932:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8367ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102265984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970378.014704:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102266112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970378.014747:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.014993:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266112 00000100:00100000:2.0:1788970378.015001:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266112 00000100:00100000:2.0:1788970378.015041:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788970378.015048:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102266112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970378.015066:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970378.015104:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102266112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.015110:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788970378.015141:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d826f0780 x1875871102266112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970378.015155:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102266112:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788970378.015305:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970378.015677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102266240:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.015717:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.015746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102266752:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.015994:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.016017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102267264:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.016040:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.016064:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788970378.016070:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102266368:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.016093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.016111:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102266880:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.016141:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.016160:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102267392:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.016179:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.016211:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266240 00000100:00100000:2.0:1788970378.016218:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266240 00000100:00100000:2.0:1788970378.016332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788970378.016340:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102266240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.016605:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102266240:12345-0@lo:400:kworker.0 Request processed in 265us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.016613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788970378.016648:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266752 00000100:00100000:2.0:1788970378.016652:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266752 00000100:00100000:2.0:1788970378.016681:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788970378.016687:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102266752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.016718:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102266752:12345-0@lo:400:kworker.0 Request processed in 31us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.016723:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788970378.016739:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102267264 00000100:00100000:2.0:1788970378.016742:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102267264 00000100:00100000:2.0:1788970378.016991:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788970378.016999:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102267264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017036:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102267264:12345-0@lo:400:kworker.0 Request processed in 38us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.017042:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788970378.017061:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266368 00000100:00100000:2.0:1788970378.017065:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266368 00000100:00100000:2.0:1788970378.017087:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266880 00000100:00100000:2.0:1788970378.017094:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266880 00000100:00100000:2.0:1788970378.017116:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102267392 00000100:00100000:2.0:1788970378.017119:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102267392 00000100:00100000:2.0:1788970378.017134:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788970378.017140:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102266368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017172:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102266368:12345-0@lo:400:kworker.0 Request processed in 32us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.017178:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788970378.017191:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788970378.017197:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102266880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017223:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102266880:12345-0@lo:400:kworker.0 Request processed in 26us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.017228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788970378.017312:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788970378.017320:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102267392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017349:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102267392:12345-0@lo:400:kworker.0 Request processed in 31us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.017355:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1788970378.017597:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970378.017603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970378.017627:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102266624:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017658:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.017682:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102267136:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017703:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.017735:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788970378.017742:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102266496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017953:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.017973:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102267008:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.017991:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.018004:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102267520:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.018022:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970378.018047:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102267136 00000100:00100000:2.0:1788970378.018051:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102267136 00000100:00100000:2.0:1788970378.018083:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970378.018089:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102267136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.018123:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102267136:12345-0@lo:400:kworker.0 Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.018128:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970378.018144:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266496 00000100:00100000:2.0:1788970378.018147:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266496 00000100:00100000:2.0:1788970378.018167:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788970378.018172:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102266496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.018213:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102266496:12345-0@lo:400:kworker.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.018218:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788970378.018301:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102266624 00000100:00100000:2.0:1788970378.018305:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102266624 00000100:00100000:2.0:1788970378.018336:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102267008 00000100:00100000:2.0:1788970378.018339:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102267008 00000100:00100000:2.0:1788970378.018372:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102267520 00000100:00100000:2.0:1788970378.018375:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102267520 00000100:00100000:2.0:1788970378.018709:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788970378.018716:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102266624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.018939:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102266624:12345-0@lo:400:kworker.0 Request processed in 223us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.018946:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788970378.018959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788970378.018967:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102267008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.018994:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102267008:12345-0@lo:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.018999:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788970378.019010:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788970378.019015:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102267520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.019036:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102267520:12345-0@lo:400:kworker.0 Request processed in 22us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970378.019041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788970378.019536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102266368:0@lo:400:kworker.0 00000100:00100000:1.0:1788970378.019551:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102266880:0@lo:400:kworker.0 00000100:00100000:1.0:1788970378.019576:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102267392:0@lo:400:kworker.0 00000100:00100000:1.0:1788970378.019587:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102266240:0@lo:400:kworker.0 00000100:00100000:1.0:1788970378.019598:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102266752:0@lo:400:kworker.0 00000100:00100000:1.0:1788970378.019608:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102267264:0@lo:400:kworker.0 00000100:00080000:3.0:1788970378.019785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970378.019792:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970378.020967:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102266496:0@lo:400:kworker.0 00010000:00080000:2.0:1788970378.020987:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eaef2b840 x1875871102267008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970378.020998:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102267008:0@lo:400:kworker.0 00010000:00080000:2.0:1788970378.021011:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ce2d00 x1875871102267520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970378.021020:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102267520:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.021033:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102266624:0@lo:400:kworker.0 00000100:00100000:2.0:1788970378.021045:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102267136:0@lo:400:kworker.0 00010000:00010000:1.0:1788970378.272437:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970379.234664:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.234743:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082249856 00000100:00100000:2.0:1788970379.234756:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082249856 00000100:00100000:2.0:1788970379.234837:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:2.0:1788970379.234851:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11122:x1875871082249856:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.234875:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.234899:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6eba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d774 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.234968:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.234984:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.234998:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235013:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235020:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235026:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235070:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235077:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235098:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235104:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.235108:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235116:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235129:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e6600) 00010000:00010000:2.0:1788970379.235132:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.235137:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235143:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ebaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235155:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235160:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235166:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235171:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.235174:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235189:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235197:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a7d823e8b00) 00010000:00010000:2.0:1788970379.235200:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.235202:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235209:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ebb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235241:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6eba3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d774 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235252:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e6600) 00010000:00010000:2.0:1788970379.235268:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.235272:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6eba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d774 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.235282:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99400, rc 0) 00000100:00100000:2.0:1788970379.235353:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11122:x1875871082249856:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 506us (699us total) trans 0 rc 301/301 00000100:00100000:2.0:1788970379.235370:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00080000:3.0:1788970379.235777:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970379.242121:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.242200:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082250112 00000100:00100000:2.0:1788970379.242209:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082250112 00000100:00100000:2.0:1788970379.242277:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:2.0:1788970379.242287:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11122:x1875871082250112:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:2.0:1788970379.242367:0:13652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970379.242419:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6eb5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d75f expref: 9 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.242438:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e6600) 00010000:00010000:2.0:1788970379.242450:0:13652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970379.242527:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.242540:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.242550:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.242563:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.242571:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.242577:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243043:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243054:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243062:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970379.243084:0:13652:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f02a2f06 reply state 0000000094b775f2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243094:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243100:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970379.243102:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970379.243104:0:13652:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788970379.243108:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788970379.243115:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243122:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243128:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243133:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.243137:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243144:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243150:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970379.243153:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.243156:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243169:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ebb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970379.243182:0:13652:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f02a2f06 reply state 0000000094b775f2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243189:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.243194:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a7d823e8800) 00010000:00010000:2.0:1788970379.243196:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970379.243197:0:13652:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788970379.243290:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+10:11122:x1875871082250112:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 1004us (1177us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788970379.243297:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00010000:00010000:1.0:1788970379.294143:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970379.354029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970379.354135:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082250240 00000100:00100000:3.0:1788970379.354146:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082250240 00000100:00100000:3.0:1788970379.354237:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1788970379.354248:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+10:11130:x1875871082250240:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:3.0:1788970379.354284:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970379.354308:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ebcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d77b expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.354434:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ebd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.354450:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ebd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.354463:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ebd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970379.354510:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788970379.354514:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970379.354552:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ebd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.354578:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ebcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d77b expref: 12 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.354599:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ebd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d77b expref: 11 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.354607:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:3.0:1788970379.354623:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970379.354627:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5c00, rc 0) 00000100:00100000:3.0:1788970379.354697:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+11:11130:x1875871082250240:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 450us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970379.354704:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1788970379.414775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970379.414908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082250368 00000100:00100000:1.0:1788970379.414918:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082250368 00000100:00100000:1.0:1788970379.414976:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:1.0:1788970379.414986:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+11:11136:x1875871082250368:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970379.415007:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970379.415027:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ebdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d782 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415091:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415106:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415118:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415129:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415158:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415165:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415248:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c6ebf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415269:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c6ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415276:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c6ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970379.415316:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788970379.415320:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970379.415371:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c6ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415425:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415433:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415441:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415446:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970379.415450:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415465:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415477:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:1.0:1788970379.415480:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970379.415486:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415492:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ebe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415506:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415512:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415517:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415522:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970379.415525:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415531:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415537:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a7d823e8800) 00010000:00010000:1.0:1788970379.415540:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970379.415542:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415557:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebe9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415586:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ebdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d782 expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415599:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c6ebf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d782 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.415606:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970379.415609:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788970379.415611:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655600, rc 0) 00000100:00100000:1.0:1788970379.415665:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+12:11136:x1875871082250368:12345-192.168.203.15@tcp:101:bash.0 Request processed in 680us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970379.415672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1788970379.421828:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970379.421925:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082250624 00000100:00100000:1.0:1788970379.421936:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082250624 00000100:00100000:1.0:1788970379.422006:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:1.0:1788970379.422019:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+12:11136:x1875871082250624:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970379.422043:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970379.422068:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ebf7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d789 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422206:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422222:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422252:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422269:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422277:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422283:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970379.422679:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788970379.422819:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422828:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422836:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422868:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422876:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422882:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422888:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970379.422899:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422908:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422921:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970379.422923:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970379.422928:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422934:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ebfe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970379.422948:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a472205 reply state 0000000009ac7527 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422959:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.422966:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:1.0:1788970379.422968:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970379.422970:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788970379.423001:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6ebf7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.423016:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.423023:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:1.0:1788970379.423026:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970379.423034:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:1.0:1788970379.423105:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+15:11136:x1875871082250624:12345-192.168.203.15@tcp:101:bash.0 Request processed in 1089us (1289us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788970379.423113:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:0.0:1788970379.428041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.428140:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082250752 00000100:00100000:2.0:1788970379.428150:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082250752 00000100:00100000:2.0:1788970379.428200:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:2.0:1788970379.428209:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875871082250752:12345-192.168.203.15@tcp:8:bash.0 00010000:00080000:2.0:1788970379.428244:0:8689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:2.0:1788970379.428276:0:8689:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6ec1a 00002000:00100000:2.0:1788970379.428288:0:8689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76727560-d4e0-4213-a4e0-b609fd69db0f/ffff8a7d83d73800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970379.428299:0:8689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788970379.428422:0:8689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788970379.428453:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d83d76800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970379.428524:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082250752:12345-192.168.203.15@tcp:8:bash.0 Request processed in 314us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.428546:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:3.0:1788970379.441100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.443245:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082250880 00000100:00100000:2.0:1788970379.443260:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082250880 00000100:00080000:3.0:1788970379.443365:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970379.443367:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1788970379.443378:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082250880:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970379.443434:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.443458:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d790 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970379.443484:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970379.443505:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1788970379.443509:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970379.443519:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.443540:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.443553:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99800, rc 0) 00000100:00100000:2.0:1788970379.443626:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:0:x1875871082250880:12345-192.168.203.15@tcp:101:bash.0 Request processed in 249us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.443632:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:3.0:1788970379.463062:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.463336:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082251008 00000100:00100000:2.0:1788970379.463346:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082251008 00000100:00100000:2.0:1788970379.463553:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:2.0:1788970379.463565:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11136:x1875871082251008:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970379.463593:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.463612:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d797 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.463643:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.463652:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970379.463657:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970379.463662:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.463695:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.463708:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970379.463723:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875871102267648:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970379.463819:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e813700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970379.466135:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875871102267648:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970379.466169:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.466261:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98a00, rc 0) 00000100:00100000:2.0:1788970379.466333:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:11136:x1875871082251008:12345-192.168.203.15@tcp:101:bash.0 Request processed in 2769us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.466342:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1788970379.468635:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970379.471863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082251136 00000100:00100000:0.0:1788970379.471879:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082251136 00010000:00010000:0.0:1788970379.471928:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970379.471992:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:0.0:1788970379.472002:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082251136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970379.472017:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970379.472043:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.472058:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.472083:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6ec21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d790 expref: 8 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.472099:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970379.472103:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970379.472110:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.472121:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.472157:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970379.472170:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1875871102267776:192.168.203.15@tcp:105: 00000100:00100000:0.0:1788970379.472261:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e856edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970379.474674:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1875871102267776:192.168.203.15@tcp:105: 00010000:00010000:0.0:1788970379.474700:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970379.474756:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082251136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 2754us (6132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970379.474768:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:3.0:1788970379.476157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.476248:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082251392 00000100:00100000:2.0:1788970379.476265:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082251392 00000100:00100000:2.0:1788970379.476325:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1788970379.476336:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:11136:x1875871082251392:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:2.0:1788970379.476932:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11136:x1875871082251392:12345-192.168.203.15@tcp:35:bash.0 Request processed in 390us (573us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788970379.476942:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:0.0:1788970379.550754:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970379.550777:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102267904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970379.550849:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970379.550976:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102267904 00000100:00100000:1.0:1788970379.550984:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102267904 00000100:00100000:1.0:1788970379.551034:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788970379.551045:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102267904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970379.551077:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970379.551133:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102267904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970379.551140:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788970379.551226:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102267904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970379.551413:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970379.551424:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102268032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970379.551459:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970379.551575:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102268032 00000100:00100000:2.0:1788970379.551580:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102268032 00000100:00100000:2.0:1788970379.551618:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788970379.551626:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102268032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970379.551637:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970379.551685:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102268032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.551692:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788970379.551860:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102268032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970379.564901:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.565001:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082251648 00000100:00100000:2.0:1788970379.565011:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082251648 00000100:00100000:2.0:1788970379.565074:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:2.0:1788970379.565086:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11146:x1875871082251648:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.565112:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.565133:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d79e expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970379.565232:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788970379.565364:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d79e expref: 18 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.565378:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:2.0:1788970379.565421:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970379.565428:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d79e expref: 18 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.565442:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99400, rc 0) 00000100:00100000:2.0:1788970379.565501:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+17:11146:x1875871082251648:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 417us (611us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788970379.565508:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:3.0:1788970379.569096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970379.569471:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082251904 00000100:00100000:0.0:1788970379.569483:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082251904 00000100:00100000:0.0:1788970379.569533:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1788970379.569543:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+17:11146:x1875871082251904:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970379.569890:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11146:x1875871082251904:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 347us (802us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788970379.569899:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1788970379.646989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.647245:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082252032 00000100:00100000:2.0:1788970379.647266:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082252032 00000100:00100000:2.0:1788970379.647446:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1788970379.647469:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11152:x1875871082252032:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.647495:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.647516:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7a5 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.647581:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ec44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.647599:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.647611:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970379.647673:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788970379.647676:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970379.647696:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.647723:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7a5 expref: 20 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.647743:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ec44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7a5 expref: 19 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.647751:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970379.647754:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970379.647758:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98c00, rc 0) 00000100:00100000:2.0:1788970379.648313:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11152:x1875871082252032:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 854us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.648321:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:3.0:1788970379.653013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.653165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082252288 00000100:00100000:2.0:1788970379.653174:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082252288 00000100:00100000:2.0:1788970379.653240:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:2.0:1788970379.653252:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11152:x1875871082252288:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.653273:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.653307:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7ac expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.653453:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.653605:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.653617:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970379.653631:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788970379.653741:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7ac expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.653760:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7ac expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.653769:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:2.0:1788970379.653772:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970379.653775:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99800, rc 0) 00000100:00100000:2.0:1788970379.653899:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:11152:x1875871082252288:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 648us (895us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788970379.653906:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:3.0:1788970379.664010:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970379.664489:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082252416 00000100:00100000:1.0:1788970379.664500:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082252416 00000100:00100000:1.0:1788970379.664573:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:1.0:1788970379.664584:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+21:2403:x1875871082252416:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970379.664602:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970379.664628:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7ac expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.664650:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:1.0:1788970379.664655:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970379.664710:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+20:2403:x1875871082252416:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 129us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970379.664718:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:1.0:1788970379.668675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.669348:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082252672 00000100:00100000:2.0:1788970379.669373:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082252672 00000100:00100000:2.0:1788970379.671228:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:2.0:1788970379.671261:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11152:x1875871082252672:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.671289:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.671311:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7b3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.671484:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.671500:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.671512:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970379.671524:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788970379.671637:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7b3 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.671656:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7b3 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.671665:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:2.0:1788970379.671667:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788970379.671670:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99400, rc 0) 00000100:00100000:2.0:1788970379.671742:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11152:x1875871082252672:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 501us (3075us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788970379.671749:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:3.0:1788970379.682169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970379.682295:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082252800 00000100:00100000:0.0:1788970379.682306:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082252800 00000100:00100000:0.0:1788970379.682377:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:0.0:1788970379.682423:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082252800:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:0.0:1788970379.682481:0:10104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.682505:0:10104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.682529:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970379.682534:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970379.682539:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.682574:0:10104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.682589:0:10104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 7 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970379.682605:0:10104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10104:1875871102268160:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970379.682701:0:10104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e856ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970379.691862:0:10104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10104:1875871102268160:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970379.691903:0:10104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970379.700823:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970379.705828:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082252928 00000100:00100000:0.0:1788970379.705845:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082252928 00002000:00100000:0.0:1788970379.706022:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8a7e91e40f00 x1875871082252928/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:155/0 lens 504/0 e 0 to 0 dl 1788970390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970379.706034:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7e91e40f00 with x1875871082252928 ext(0->12) 00010000:00010000:0.0:1788970379.706045:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 8 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.706081:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 8 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970379.706090:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7e91e40f00 00000100:00100000:0.0:1788970379.706133:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970379.706143:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082252928:12345-192.168.203.15@tcp:4:lfs.0 00000001:00100000:3.0:1788970379.710539:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000100:00100000:0.0:1788970379.711161:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082252928:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 5013us (10341us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788970379.711173:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00002000:00100000:0.0:1788970379.711185:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8a7e91e40f00 x1875871082252928/t4294967300(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:155/0 lens 504/448 e 0 to 0 dl 1788970390 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970379.711196:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7e91e40f00 with x1875871082252928 ext(0->12) 00010000:00010000:0.0:1788970379.711219:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 9 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970379.711237:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 9 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970379.711245:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7e91e40f00 00000100:00100000:3.0:1788970379.718969:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970379.719268:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082253056 00000100:00100000:1.0:1788970379.719302:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082253056 00010000:00010000:1.0:1788970379.719363:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 9 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970379.719416:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:1.0:1788970379.719426:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2401:x1875871082253056:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970379.719440:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788970379.719598:0:7932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788970379.719602:0:7932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788970379 00002000:00010000:1.0:1788970379.719604:0:7932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788970379 00002000:00010000:1.0:1788970379.719606:0:7932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788970379 00002000:00010000:1.0:1788970379.719609:0:7932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788970379.719616:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 9 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.719632:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 9 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.719658:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a239a8e3/0xc3abfebe76c6ec28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d797 expref: 9 pid: 8440 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.719674:0:7932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970379.719678:0:7932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970379.719684:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.719695:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970379.719734:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970379.719829:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2401:x1875871082253056:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 404us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970379.719837:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00010000:00010000:2.0:1788970379.720655:0:10104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720669:0:10104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720709:0:10104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720718:0:10104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720726:0:10104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720733:0:10104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970379.720737:0:10104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720746:0:10104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720763:0:10104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.720771:0:10104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e564241/0xc3abfebe76c6ec75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970379.720834:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082252800:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 38414us (38674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.720842:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:1.0:1788970379.728096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.728169:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082253312 00000100:00100000:2.0:1788970379.728179:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082253312 00000100:00100000:2.0:1788970379.728243:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970379.728260:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11152:x1875871082253312:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:2.0:1788970379.728336:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7b3 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970379.728934:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788970379.728976:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788970379.729233:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788970379.729686:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.729703:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.729712:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.729748:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.729765:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 26 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970379.729779:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce03c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875871102268288:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970379.729954:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970379.741729:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce03c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875871102268288:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970379.741847:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970379.743231:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.745086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082253440 00000100:00100000:2.0:1788970379.745103:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082253440 00010000:00010000:2.0:1788970379.745157:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 27 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970379.745210:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:2.0:1788970379.745222:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+27:2403:x1875871082253440:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970379.745237:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970379.745245:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 27 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.745272:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 27 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.745297:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ec0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d789 expref: 27 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.745314:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:2.0:1788970379.745320:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.745329:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.745336:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.745428:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970379.745496:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+26:2403:x1875871082253440:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 276us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.745504:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00010000:00010000:3.0:1788970379.745702:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.745711:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970379.745838:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788970379.745980:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788970379.746062:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e91e43840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875871102268416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788970379.746113:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970379.746151:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970379.746861:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102268416 00000100:00100000:2.0:1788970379.746869:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102268416 00000100:00100000:2.0:1788970379.747242:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788970379.747263:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875871102268416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788970379.747411:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875871102268416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 160us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.747419:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788970379.747508:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e91e43840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875871102268416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788970379.747668:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788970379.747724:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e91e43840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875871102268544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788970379.747753:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970379.751712:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102268544 00000100:00100000:0.0:1788970379.751730:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102268544 00000100:00100000:3.0:1788970379.751744:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970379.751791:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788970379.751802:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1875871102268544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788970379.752124:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1875871102268544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 316us (4360us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788970379.752146:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788970379.752628:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e91e43840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875871102268544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788970379.752761:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788970379.752808:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.752820:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.752828:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.752835:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970379.752902:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.752911:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.752939:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:3.0:1788970379.752942:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788970379.752947:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.752954:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ec7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970379.753064:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788970379.753578:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788970379.753591:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399020209427ns, next at 400020206847ns, rc = 0 00000001:00080000:3.0:1788970379.753600:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788970379.753633:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7eb55b5c00) 00010000:00010000:3.0:1788970379.753636:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788970379.753707:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7b3 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970379.754740:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+29:11152:x1875871082253312:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 26484us (26648us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788970379.754750:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000020:00080000:3.0:1788970379.754756:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788970379.760681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.762199:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082253568 00000100:00100000:2.0:1788970379.762210:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082253568 00000100:00100000:2.0:1788970379.762801:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:2.0:1788970379.762813:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+29:11152:x1875871082253568:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.762839:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.762863:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6ec83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7ba expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.764860:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6ec83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7ba expref: 30 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.764897:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6ec83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7ba expref: 30 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.764919:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970379.764937:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970379.764941:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98a00, rc 0) 00000100:00100000:2.0:1788970379.765022:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11152:x1875871082253568:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2211us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.765031:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:1.0:1788970379.770825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970379.771178:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082253824 00000100:00100000:0.0:1788970379.771187:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082253824 00000100:00100000:0.0:1788970379.771248:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:0.0:1788970379.771259:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11152:x1875871082253824:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970379.771515:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+31:11152:x1875871082253824:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 258us (698us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788970379.771522:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970379.897616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970379.897737:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082254080 00000100:00100000:3.0:1788970379.897748:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082254080 00000100:00100000:3.0:1788970379.897807:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:3.0:1788970379.897819:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+31:11162:x1875871082254080:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970379.897845:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970379.897867:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ec8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7c1 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970379.898005:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788970379.898106:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ec8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c1 expref: 33 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.898122:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:3.0:1788970379.898126:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970379.898131:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ec8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c1 expref: 33 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970379.898148:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4e00, rc 0) 00000100:00100000:3.0:1788970379.898224:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11162:x1875871082254080:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 407us (623us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788970379.898232:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:1.0:1788970379.902193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.902298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082254208 00000100:00100000:2.0:1788970379.902308:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082254208 00000100:00100000:2.0:1788970379.902687:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:2.0:1788970379.902701:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11162:x1875871082254208:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:2.0:1788970379.902805:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902826:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902838:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902850:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902857:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902864:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902946:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902956:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.902977:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970379.903035:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903049:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903055:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903063:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903070:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.903074:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903082:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903094:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970379.903098:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.903103:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903110:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ec98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903124:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903137:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903143:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903149:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.903152:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903158:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903167:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:2.0:1788970379.903169:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.903172:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903179:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ec9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903189:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903195:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903201:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903206:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.903218:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903225:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903234:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970379.903237:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.903239:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.903246:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6eca6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970379.903618:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11162:x1875871082254208:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 635us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.903630:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1788970379.905800:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970379.906216:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082254464 00000100:00100000:3.0:1788970379.906227:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082254464 00000100:00100000:3.0:1788970379.906297:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1788970379.906308:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11162:x1875871082254464:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970379.906678:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+33:11162:x1875871082254464:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 371us (887us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788970379.906687:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:1.0:1788970379.961490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.961599:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082254720 00000100:00100000:2.0:1788970379.961610:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082254720 00000100:00100000:2.0:1788970379.961671:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:2.0:1788970379.961682:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+33:11165:x1875871082254720:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970379.961704:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970379.961737:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ecad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7c8 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.961816:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.961832:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.961856:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.961868:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.961876:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.961883:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962002:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962011:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962017:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970379.962027:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788970379.962120:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962129:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962136:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962142:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.962152:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962161:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962173:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970379.962176:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.962181:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962187:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ecb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962201:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962207:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962213:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962218:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.962220:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962226:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962233:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:2.0:1788970379.962236:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970379.962244:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962261:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ecbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962302:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ecad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 36 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962317:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 35 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.962324:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970379.962327:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970379.962329:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a200, rc 0) 00000100:00100000:2.0:1788970379.962456:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11165:x1875871082254720:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 774us (974us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788970379.962463:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1788970379.970493:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970379.970579:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082254848 00000100:00100000:2.0:1788970379.970604:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082254848 00000100:00100000:2.0:1788970379.970664:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1788970379.970676:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11165:x1875871082254848:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1788970379.970739:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970755:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970768:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970837:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970844:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970852:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970859:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ac00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970379.970864:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970872:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970884:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970379.970887:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970379.970892:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970379.970899:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970379.970968:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11165:x1875871082254848:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 293us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970379.970976:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1788970379.974057:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970379.974149:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082255104 00000100:00100000:3.0:1788970379.974159:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082255104 00000100:00100000:3.0:1788970379.974221:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:3.0:1788970379.974233:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11165:x1875871082255104:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970379.974525:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+36:11165:x1875871082255104:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 293us (477us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788970379.974548:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:1.0:1788970380.247507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970380.247575:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082255360 00000100:00100000:2.0:1788970380.247585:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082255360 00000100:00100000:2.0:1788970380.247650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1788970380.247675:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+36:11196:x1875871082255360:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:2.0:1788970380.247700:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970380.247719:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7cf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.247837:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ecde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.247852:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ecde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.247863:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ecde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970380.247875:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788970380.248016:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7cf expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.248035:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ecde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7cf expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.248044:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970380.248047:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970380.248051:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a800, rc 0) 00000100:00100000:2.0:1788970380.248111:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11196:x1875871082255360:12345-192.168.203.15@tcp:101:cat.0 Request processed in 438us (613us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788970380.248118:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:1.0:1788970380.253617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970380.253716:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082255488 00000100:00100000:0.0:1788970380.253727:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082255488 00000100:00100000:0.0:1788970380.253796:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1788970380.253808:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+38:2401:x1875871082255488:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970380.253824:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970380.253850:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ecde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7cf expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.253870:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970380.253875:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970380.254023:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+37:2401:x1875871082255488:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 216us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970380.254030:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:3.0:1788970380.254221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970380.254506:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082255744 00000100:00100000:0.0:1788970380.254512:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082255744 00000100:00100000:0.0:1788970380.254551:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:0.0:1788970380.254559:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+37:11196:x1875871082255744:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:0.0:1788970380.254804:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11196:x1875871082255744:12345-192.168.203.15@tcp:35:cat.0 Request processed in 246us (583us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788970380.254812:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00010000:00010000:1.0:1788970380.317204:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970380.317216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970380.317415:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256000 00000100:00100000:2.0:1788970380.317424:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256000 00000100:00100000:2.0:1788970380.317498:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1788970380.317509:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11202:x1875871082256000:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:2.0:1788970380.317533:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970380.317536:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970380.317562:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ec44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7a5 expref: 38 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.317581:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970380.317586:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970380.317598:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7d6 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.317719:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.317748:0:10102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 38 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.317756:0:10102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.317788:0:10102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 38 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.317800:0:10102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 38 pid: 13652 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970380.317813:0:10102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102268672:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970380.317923:0:10102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970380.321766:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970380.321879:0:10102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102268672:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970380.321907:0:10102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970380.322039:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256128 00000100:00100000:1.0:1788970380.322047:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256128 00010000:00010000:1.0:1788970380.322087:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 39 pid: 13652 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970380.322134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:1.0:1788970380.322143:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+39:2403:x1875871082256128:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970380.322157:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970380.322165:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 39 pid: 13652 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970380.322194:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 39 pid: 13652 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970380.322219:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6ecc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7c8 expref: 39 pid: 13652 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970380.322235:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:1.0:1788970380.322240:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970380.322250:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970380.322257:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970380.322426:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970380.322483:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e42580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+38:2403:x1875871082256128:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 339us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970380.322491:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00010000:00010000:2.0:1788970380.322759:0:10102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.322768:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970380.322787:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788970380.322964:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6ecec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 39 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.322982:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 38 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.322990:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970380.322993:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970380.322995:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9bc00, rc 0) 00000100:00100000:2.0:1788970380.323138:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11202:x1875871082256000:12345-192.168.203.15@tcp:101:dd.0 Request processed in 5630us (5927us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788970380.323147:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:3.0:1788970380.334748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970380.334828:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256256 00000100:00100000:2.0:1788970380.334841:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256256 00000100:00100000:2.0:1788970380.334901:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1788970380.334912:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11202:x1875871082256256:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:2.0:1788970380.334948:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970380.334977:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ed01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7dd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.335011:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.335026:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.335037:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.335149:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6ed01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.335171:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.335180:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970380.335185:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970380.335189:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99200, rc 0) 00000100:00100000:2.0:1788970380.335253:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+39:11202:x1875871082256256:12345-192.168.203.15@tcp:101:dd.0 Request processed in 343us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970380.335260:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1788970380.341648:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970380.341749:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256512 00000100:00100000:3.0:1788970380.341759:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256512 00000100:00100000:3.0:1788970380.341824:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:3.0:1788970380.341835:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+39:11202:x1875871082256512:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:3.0:1788970380.342069:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970380.342087:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970380.342098:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970380.342140:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788970380.342164:0:13652:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b82fcac reply state 0000000001ccba8a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970380.342176:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970380.342183:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:3.0:1788970380.342186:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970380.342190:0:13652:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970380.342310:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+42:11202:x1875871082256512:12345-192.168.203.15@tcp:36:dd.0 Request processed in 475us (669us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788970380.342333:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000020:00080000:3.0:1788970380.342339:0:13652:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970380.483607:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970380.483656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970380.483693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970380.483726:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970380.483754:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970380.483864:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256896 00000100:00100000:0.0:1788970380.483875:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256896 00000100:00100000:0.0:1788970380.483947:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:0.0:1788970380.483960:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082256896:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970380.484056:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e40780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082256896:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 98us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970380.484064:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:2.0:1788970380.484260:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082257152 00000100:00100000:2.0:1788970380.484265:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082257152 00000100:00100000:2.0:1788970380.484320:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256768 00000100:00100000:2.0:1788970380.484338:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256768 00000100:00100000:2.0:1788970380.484372:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082257024 00000100:00100000:2.0:1788970380.484374:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082257024 00000100:00100000:2.0:1788970380.484422:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 270 00000100:00100000:2.0:1788970380.484430:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082257152:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970380.484462:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082257152:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 34us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970380.484469:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 270 00000100:00100000:2.0:1788970380.484484:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 271 00000100:00100000:2.0:1788970380.484490:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082256768:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970380.484516:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082256768:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970380.484521:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 271 00000100:00100000:2.0:1788970380.484533:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 272 00000100:00100000:2.0:1788970380.484539:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082257024:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970380.484559:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082257024:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970380.484564:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 272 00000100:00080000:3.0:1788970380.484938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970380.484943:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970380.486357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082256640 00000100:00100000:1.0:1788970380.486368:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082256640 00000100:00100000:1.0:1788970380.486453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 375 00000100:00100000:1.0:1788970380.486462:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082256640:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970380.486524:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082256640:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 63us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970380.486531:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 375 00000100:00100000:2.0:1788970380.573704:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e91e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102268800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970380.573778:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970380.573921:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102268800 00000100:00100000:3.0:1788970380.573931:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102268800 00000100:00100000:3.0:1788970380.573987:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788970380.573997:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102268800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970380.574041:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788970380.574098:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102268800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970380.574105:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788970380.574250:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e91e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102268800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970380.844016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970380.844175:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082257280 00000100:00100000:2.0:1788970380.844186:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082257280 00000100:00100000:2.0:1788970380.844268:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:2.0:1788970380.844279:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+42:11216:x1875871082257280:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:2.0:1788970380.844304:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970380.844337:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ed16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7e4 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844468:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844484:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844497:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844510:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844516:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844523:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844595:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844606:0:10102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 43 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844615:0:10102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844648:0:10102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 43 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.844673:0:10102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 43 pid: 10102 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970380.844687:0:10102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102268928:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970380.844796:0:10102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970380.848016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970380.848326:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082257536 00000100:00100000:0.0:1788970380.848338:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082257536 00000100:00100000:0.0:1788970380.848436:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:0.0:1788970380.848447:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+44:6172:x1875871082257536:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788970380.848776:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+45:6172:x1875871082257536:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 329us (768us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788970380.848785:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:2.0:1788970380.851193:0:10102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102268928:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970380.851583:0:10102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970380.855759:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970380.855876:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082257664 00000100:00100000:0.0:1788970380.855886:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082257664 00010000:00010000:0.0:1788970380.855926:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 45 pid: 10102 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970380.856014:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:0.0:1788970380.856025:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+45:2400:x1875871082257664:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970380.856056:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970380.856063:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 45 pid: 10102 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.856078:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 45 pid: 10102 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.856100:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6ecf3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7d6 expref: 45 pid: 10102 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.856118:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970380.856124:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.856134:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.856142:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.856188:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970380.856261:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+44:2400:x1875871082257664:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 237us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970380.856270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00010000:00010000:2.0:1788970380.857036:0:10102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857047:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970380.857098:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788970380.857102:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970380.857142:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857166:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857176:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857183:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857213:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857219:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970380.857223:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857230:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857241:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970380.857244:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970380.857247:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857253:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6ed1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857265:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857270:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857274:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857279:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970380.857282:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857297:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857304:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:2.0:1788970380.857306:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970380.857310:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857316:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6ed24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857360:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6ed16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7e4 expref: 44 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857376:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7e4 expref: 43 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970380.857431:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970380.857433:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970380.857435:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215ae00, rc 0) 00000100:00100000:2.0:1788970380.857963:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+43:11216:x1875871082257280:12345-192.168.203.15@tcp:101:stat.0 Request processed in 13683us (13964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970380.857971:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:1.0:1788970380.922956:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970380.923133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082257920 00000100:00100000:0.0:1788970380.923144:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082257920 00000100:00100000:0.0:1788970380.923213:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970380.923224:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+43:11222:x1875871082257920:12345-192.168.203.15@tcp:36:truncate.0 00010000:00010000:0.0:1788970380.923300:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970380.923335:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ed2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7e4 expref: 43 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.923367:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970380.923372:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970380.923778:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.923794:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.923804:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970380.923852:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788970380.923880:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdfc72aa reply state 000000000a67fc9f transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.923893:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970380.923899:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970380.923902:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970380.923905:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970380.924198:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+45:11222:x1875871082257920:12345-192.168.203.15@tcp:36:truncate.0 Request processed in 974us (1251us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788970380.924206:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000020:00080000:0.0:1788970380.924211:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788970381.183370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970381.183439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082258048 00000100:00100000:2.0:1788970381.183449:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082258048 00000100:00100000:2.0:1788970381.183538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:2.0:1788970381.183548:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+45:11236:x1875871082258048:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:2.0:1788970381.183587:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970381.183609:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ed39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7eb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183673:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183688:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183699:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183711:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183718:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183725:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183798:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183807:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183814:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970381.183856:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788970381.183866:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970381.183888:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183901:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183909:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183915:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183922:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183929:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970381.183933:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183942:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183952:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970381.183956:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970381.183960:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183966:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ed40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.183980:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184002:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184007:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184013:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970381.184016:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184022:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184031:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:2.0:1788970381.184034:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970381.184037:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184042:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ed47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184071:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ed39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 47 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184084:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.184091:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970381.184093:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970381.184102:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b800, rc 0) 00000100:00100000:2.0:1788970381.184166:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+46:11236:x1875871082258048:12345-192.168.203.15@tcp:101:stat.0 Request processed in 619us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970381.184173:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00080000:3.0:1788970381.184409:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970381.304152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970381.304302:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082258304 00000100:00100000:2.0:1788970381.304312:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082258304 00000100:00100000:2.0:1788970381.304419:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:2.0:1788970381.304430:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+46:11246:x1875871082258304:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970381.304450:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970381.304468:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ed55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7f2 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970381.304581:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788970381.304680:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ed55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f2 expref: 48 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.304694:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:2.0:1788970381.304697:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970381.304702:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ed55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f2 expref: 48 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.304715:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215a200, rc 0) 00000100:00100000:2.0:1788970381.304775:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+47:11246:x1875871082258304:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 347us (633us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788970381.304783:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1788970381.310654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.311311:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082258560 00000100:00100000:0.0:1788970381.311351:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082258560 00000100:00100000:0.0:1788970381.311457:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970381.311468:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+47:11246:x1875871082258560:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970381.311736:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+48:11246:x1875871082258560:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 269us (1098us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788970381.311744:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00010000:00010000:1.0:1788970381.341156:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970381.405116:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788970381.406484:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970381.418611:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.429331:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082258816 00000100:00100000:0.0:1788970381.429365:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082258816 00000100:00100000:0.0:1788970381.429557:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:0.0:1788970381.429571:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+48:11252:x1875871082258816:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970381.429606:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970381.429635:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d7f9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.430797:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.430829:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.430841:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.430890:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.430911:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 49 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970381.430947:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102269056:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970381.431132:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e888d59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970381.458760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.458968:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef1680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102269056:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970381.459005:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970381.459229:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082258944 00000100:00100000:1.0:1788970381.459240:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082258944 00010000:00010000:1.0:1788970381.459296:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 50 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970381.459356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1788970381.459368:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+50:2402:x1875871082258944:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970381.459443:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970381.459452:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 50 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.459466:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 50 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.459496:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ed4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7eb expref: 50 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.459516:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:1.0:1788970381.459522:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.459557:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.459567:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.459590:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970381.459750:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.459758:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970381.459782:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788970381.459971:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.459991:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 50 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.460000:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970381.460002:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970381.460005:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012a00, rc 0) 00000100:00100000:0.0:1788970381.460061:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+50:11252:x1875871082258816:12345-192.168.203.15@tcp:101:bash.0 Request processed in 30492us (41466us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788970381.460069:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:1.0:1788970381.460726:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+49:2402:x1875871082258944:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1353us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970381.460738:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:3.0:1788970381.471512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.471698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082259200 00000100:00100000:0.0:1788970381.471731:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082259200 00000100:00100000:0.0:1788970381.471810:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:0.0:1788970381.471823:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+49:11252:x1875871082259200:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:0.0:1788970381.472237:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.472261:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.472276:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970381.472327:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788970381.472363:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd7d3fd2 reply state 00000000a3dba207 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.472418:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.472429:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970381.472432:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970381.475604:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970381.475920:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+52:11252:x1875871082259200:12345-192.168.203.15@tcp:36:bash.0 Request processed in 4089us (4413us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788970381.475933:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000020:00080000:0.0:1788970381.475942:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788970381.485773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970381.486003:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082259328 00000100:00100000:3.0:1788970381.486017:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082259328 00000100:00100000:3.0:1788970381.486091:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1788970381.486105:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+52:11252:x1875871082259328:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970381.486156:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970381.486194:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ed7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d800 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970381.486352:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970381.486373:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970381.486432:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970381.486491:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970381.486509:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 53 pid: 6525 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970381.486526:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102269184:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970381.487714:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970381.495334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970381.499202:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082259456 00000100:00100000:1.0:1788970381.499226:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082259456 00010000:00010000:1.0:1788970381.499318:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 54 pid: 6525 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970381.499455:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1788970381.499468:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+54:2402:x1875871082259456:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970381.499487:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970381.499497:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 54 pid: 6525 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.499515:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 54 pid: 6525 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.499545:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:1.0:1788970381.499552:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.499591:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.499601:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.499630:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970381.499979:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+54:2402:x1875871082259456:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 512us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970381.499989:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00010000:00010000:0.0:1788970381.502941:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ed6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7f9 expref: 53 pid: 6525 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970381.502977:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102269184:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970381.503035:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.506202:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.507159:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970381.507327:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788970381.507334:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970381.507376:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.507765:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6ed7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d800 expref: 53 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.507798:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d800 expref: 52 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.507810:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970381.507813:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970381.507818:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4e00, rc 0) 00000100:00100000:2.0:1788970381.507975:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+52:11252:x1875871082259328:12345-192.168.203.15@tcp:101:bash.0 Request processed in 21869us (22215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970381.507986:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1788970381.534094:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.534215:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082259712 00000100:00100000:0.0:1788970381.534230:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082259712 00000100:00100000:0.0:1788970381.534306:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970381.534318:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+52:11252:x1875871082259712:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:0.0:1788970381.534861:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+53:11252:x1875871082259712:12345-192.168.203.15@tcp:35:bash.0 Request processed in 542us (778us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788970381.534872:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:1.0:1788970381.667282:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.668105:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082259968 00000100:00100000:0.0:1788970381.668121:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082259968 00000100:00100000:1.0:1788970381.668445:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1788970381.668461:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+53:11263:x1875871082259968:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970381.668496:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970381.668524:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ed8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d807 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970381.670928:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788970381.671122:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ed8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d807 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.671143:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:1.0:1788970381.671147:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970381.671154:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6ed8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d807 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970381.671175:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:1.0:1788970381.672061:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11263:x1875871082259968:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 3598us (4788us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788970381.672075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:3.0:1788970381.679591:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.680603:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082260096 00000100:00100000:0.0:1788970381.680721:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082260096 00000100:00100000:0.0:1788970381.680944:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:0.0:1788970381.680958:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11263:x1875871082260096:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1788970381.681071:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681094:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681109:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681122:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681129:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681155:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681272:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681281:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681289:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970381.681372:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681525:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681534:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681541:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681547:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970381.681552:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681561:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681577:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970381.681589:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970381.681597:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681603:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ed9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681620:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681626:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681631:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681636:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970381.681650:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681657:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681664:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:0.0:1788970381.681667:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970381.681670:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681675:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6eda2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681686:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681699:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681704:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681709:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970381.681712:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681718:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681820:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970381.681824:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970381.681828:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.681833:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6eda9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970381.682006:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11263:x1875871082260096:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 1048us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970381.682015:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:0.0:1788970381.685937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970381.686037:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082260352 00000100:00100000:3.0:1788970381.686051:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082260352 00000100:00100000:3.0:1788970381.686154:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1788970381.686168:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11263:x1875871082260352:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970381.686571:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+55:11263:x1875871082260352:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 404us (647us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788970381.686580:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:1.0:1788970381.725458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970381.725575:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082260608 00000100:00100000:2.0:1788970381.725591:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082260608 00000100:00100000:2.0:1788970381.725679:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1788970381.725692:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+55:11266:x1875871082260608:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970381.725741:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970381.725771:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6edb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d80e expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.725909:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.725930:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.725944:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.725959:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.725966:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.725972:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726128:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726139:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726147:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970381.726160:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788970381.726270:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726288:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726296:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726303:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970381.726308:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726317:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726332:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970381.726335:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970381.726352:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726359:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6edb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726377:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726451:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726458:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726464:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970381.726477:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726484:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726493:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:2.0:1788970381.726496:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970381.726499:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726506:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6edbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726565:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6edb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d80e expref: 58 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726583:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d80e expref: 57 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.726591:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970381.726594:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970381.726597:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b800, rc 0) 00000100:00100000:2.0:1788970381.726699:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+57:11266:x1875871082260608:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1009us (1257us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788970381.726708:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:1.0:1788970381.738894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.739226:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082260736 00000100:00100000:0.0:1788970381.739250:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082260736 00000100:00100000:0.0:1788970381.739359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:0.0:1788970381.739372:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+57:11266:x1875871082260736:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1788970381.739558:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739587:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739605:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739654:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739662:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739669:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739675:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970381.739680:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739689:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739702:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970381.739705:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970381.739711:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.739718:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970381.739826:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+57:11266:x1875871082260736:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 455us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970381.739835:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:1.0:1788970381.750137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970381.750191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970381.750296:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082261120 00000100:00100000:2.0:1788970381.750309:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082261120 00000100:00100000:2.0:1788970381.750452:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:2.0:1788970381.750465:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+57:2401:x1875871082261120:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970381.750505:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970381.750541:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d80e expref: 57 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970381.750568:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970381.750575:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970381.750672:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+56:2401:x1875871082261120:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 209us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970381.750680:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:0.0:1788970381.750861:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082260992 00000100:00100000:0.0:1788970381.750870:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082260992 00000100:00100000:0.0:1788970381.750915:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970381.750923:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+56:11266:x1875871082260992:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970381.751163:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+57:11266:x1875871082260992:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 239us (1041us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788970381.751170:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1788970381.978789:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970381.978956:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082261376 00000100:00100000:0.0:1788970381.978971:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082261376 00000100:00100000:0.0:1788970381.979056:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:0.0:1788970381.979071:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+57:11284:x1875871082261376:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:0.0:1788970381.979106:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970381.979137:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d815 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.979302:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ede1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.979324:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ede1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.979349:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ede1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970381.979448:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788970381.979602:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d815 expref: 60 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.979626:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ede1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d815 expref: 59 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970381.979635:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970381.979638:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788970381.979643:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013800, rc 0) 00000100:00100000:0.0:1788970381.981693:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11284:x1875871082261376:12345-192.168.203.15@tcp:101:cat.0 Request processed in 2607us (2900us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788970381.981720:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:3.0:1788970382.024620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.025254:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082261504 00000100:00100000:0.0:1788970382.025269:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082261504 00000100:00100000:0.0:1788970382.025507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:0.0:1788970382.025522:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11285:x1875871082261504:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970382.025554:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970382.025582:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d81c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.025700:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6edf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.025720:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.025801:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970382.025954:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788970382.025960:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970382.025987:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6edf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.026024:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6edef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d81c expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.026050:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6edf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d81c expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.026060:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970382.026063:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970382.026068:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013200, rc 0) 00000100:00100000:0.0:1788970382.026154:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11285:x1875871082261504:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 636us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970382.026162:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:1.0:1788970382.033661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.033761:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082261888 00000100:00100000:0.0:1788970382.033775:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082261888 00000100:00100000:0.0:1788970382.033934:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1788970382.033946:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11285:x1875871082261888:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970382.034463:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11285:x1875871082261888:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 518us (814us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788970382.034471:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970382.037645:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.037735:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262016 00000100:00100000:2.0:1788970382.037754:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262016 00000100:00100000:2.0:1788970382.037846:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1788970382.037859:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11285:x1875871082262016:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:2.0:1788970382.037877:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788970382.037908:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6ed86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d800 expref: 61 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.037938:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ede1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d815 expref: 60 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.037955:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6ec83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7ba expref: 59 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.037967:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.037972:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970382.038470:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11285:x1875871082262016:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 611us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.038498:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1788970382.043106:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.053463:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262144 00000100:00100000:2.0:1788970382.053484:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262144 00000100:00100000:2.0:1788970382.053615:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:2.0:1788970382.053628:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11285:x1875871082262144:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:2.0:1788970382.053793:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.053821:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.053836:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970382.054135:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970382.056855:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788970382.057056:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788970382.057346:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11285:x1875871082262144:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 3705us (14243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.057361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:1.0:1788970382.084524:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.084924:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262272 00000100:00100000:0.0:1788970382.084937:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262272 00000100:00100000:0.0:1788970382.085012:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:0.0:1788970382.085023:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11287:x1875871082262272:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970382.085048:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970382.085074:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ee04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d823 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.085161:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.085180:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.085194:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.085205:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.085213:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.085219:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086063:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086083:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086115:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970382.086176:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788970382.086182:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970382.086205:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086220:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086230:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086622:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086632:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086639:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970382.086644:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086654:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086671:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970382.086675:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970382.086681:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086700:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ee0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086722:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086808:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086864:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086870:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970382.086873:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086881:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086890:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:0.0:1788970382.086893:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970382.086896:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.086901:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6ee12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.087152:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ee04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 60 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.087188:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 59 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.087195:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970382.087198:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970382.087201:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012a00, rc 0) 00000100:00100000:1.0:1788970382.087607:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11287:x1875871082262272:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2581us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970382.087619:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:2.0:1788970382.109090:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970382.109125:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102269312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970382.109219:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970382.109545:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102269312 00000100:00100000:1.0:1788970382.109558:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102269312 00000100:00100000:1.0:1788970382.109634:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788970382.109648:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102269312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970382.109698:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788970382.109765:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102269312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970382.109773:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788970382.109914:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102269312:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788970382.367701:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970382.428680:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970382.428695:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970382.428762:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788970382.428774:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970382.428991:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102269440:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970382.429130:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e83e6c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970382.446498:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb5959e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102269440:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970382.449097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.449216:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262400 00000100:00100000:2.0:1788970382.449231:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262400 00000100:00100000:2.0:1788970382.449331:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:2.0:1788970382.449352:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11298:x1875871082262400:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970382.449414:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970382.449578:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11298:x1875871082262400:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 227us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.449586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00000001:00080000:3.0:1788970382.454958:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1788970382.455028:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788970382.455056:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7d837bdf00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788970382.455062:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d8273c700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d837bdcc0 00000020:00080000:3.0:1788970382.455066:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d8273c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d836e1600 00000020:00080000:3.0:1788970382.455140:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788970382.455446:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788970382.455623:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970382.455648:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e91e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102269568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788970382.455742:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970382.456428:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456444:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456454:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456461:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.456468:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456477:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456499:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a7d823e8800) 00010000:00010000:2.0:1788970382.456502:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.456509:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456516:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6ebbf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456560:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456566:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456572:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456578:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.456581:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456587:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456595:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970382.456598:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.456601:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456607:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6ebc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456625:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456645:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456653:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456666:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.456670:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456677:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456686:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7eb55b5e00) 00010000:00010000:2.0:1788970382.456688:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.456692:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456698:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ec05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456717:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456732:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456739:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456744:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.456748:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456754:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456773:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.456775:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.456778:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456784:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6ed0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456797:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456803:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456810:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456816:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.456818:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456825:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456833:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.456835:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.456838:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456844:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ed32 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456867:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456873:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456879:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456884:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.456887:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456894:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456903:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.456905:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.456908:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.456914:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ed78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.456944:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102269568 00000100:00100000:2.0:1788970382.456957:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102269568 00000100:00100000:2.0:1788970382.457040:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788970382.457053:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102269568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788970382.457090:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788970382.457127:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa1858b, atime: 0x6aa1858b, ctime: 0x6aa1858b, blocks: 0x8 00010000:00010000:2.0:1788970382.457141:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.457157:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1788970382.457163:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970382.457169:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.457187:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.457197:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.457204:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.457228:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970382.457331:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970382.457357:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.457367:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970382.457371:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.457406:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.457424:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.457432:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000054246a2/0xc3abfebe76c6ee20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.457453:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970382.457456:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970382.457458:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970382.457492:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102269568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 442us (1749us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788970382.457501:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1788970382.457518:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7e91e403c0/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788970382.457527:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e91e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102269568:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788970382.458360:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970382.458878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.459111:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262528 00000100:00100000:2.0:1788970382.459121:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262528 00000100:00100000:2.0:1788970382.459238:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:2.0:1788970382.459249:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+12:11298:x1875871082262528:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788970382.459435:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.459468:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.459482:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462481:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462509:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462524:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462565:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462574:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462580:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970382.462635:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788970382.462640:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970382.462656:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462670:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462696:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462701:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462707:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.462711:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462718:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462731:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:2.0:1788970382.462734:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.462954:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462967:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462983:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462990:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.462997:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463002:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.463011:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463018:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463027:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8a7d823e8800) 00010000:00010000:2.0:1788970382.463029:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.463032:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463038:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee2e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463056:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463061:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463066:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463070:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.463072:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463077:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463083:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.463085:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.463093:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.463098:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.463205:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+12:11298:x1875871082262528:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 3953us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.463216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:2.0:1788970382.469452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.469617:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262784 00000100:00100000:1.0:1788970382.469627:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262784 00000100:00100000:1.0:1788970382.469698:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:1.0:1788970382.469719:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+12:11298:x1875871082262784:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970382.469749:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970382.469784:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d82a expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.469897:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.469913:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.469925:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970382.469936:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788970382.470020:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470028:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470035:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470041:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970382.470045:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470052:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470063:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:1.0:1788970382.470065:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970382.470070:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470086:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470128:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee3c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d82a expref: 14 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470137:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:1.0:1788970382.470139:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970382.470143:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d82a expref: 14 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.470151:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:1.0:1788970382.470211:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11298:x1875871082262784:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 500us (764us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788970382.470220:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:1.0:1788970382.475437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.475521:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082262912 00000100:00100000:3.0:1788970382.475530:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082262912 00000100:00100000:3.0:1788970382.475584:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:3.0:1788970382.475593:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11298:x1875871082262912:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788970382.475680:0:13652:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970382.475932:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11298:x1875871082262912:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 339us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.475939:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:3.0:1788970382.484631:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.484726:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082263168 00000100:00100000:2.0:1788970382.484738:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082263168 00000100:00100000:2.0:1788970382.484807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:2.0:1788970382.484818:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11298:x1875871082263168:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970382.484840:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970382.484843:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970382.484869:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6edf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d81c expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.484889:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970382.484895:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970382.484908:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d831 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970382.485317:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788970382.485521:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.485536:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.485567:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.485641:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ee51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d831 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.485658:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d831 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.485667:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8800) 00010000:00010000:2.0:1788970382.485670:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970382.485673:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b600, rc 0) 00000100:00100000:2.0:1788970382.485733:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082263168:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 916us (1111us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788970382.485740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:2.0:1788970382.489948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.494203:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082263424 00000100:00100000:1.0:1788970382.494423:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082263424 00000100:00100000:1.0:1788970382.494505:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:1.0:1788970382.494517:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082263424:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970382.494580:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970382.494625:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6ee58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d831 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494645:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8800) 00010000:00010000:1.0:1788970382.494657:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970382.494694:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494709:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494721:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494737:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494744:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494752:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494801:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494809:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494816:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494822:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970382.494827:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494835:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494855:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970382.494858:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970382.494863:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494869:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494880:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494887:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494893:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494898:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970382.494901:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494907:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494914:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa0c0feea (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970382.494916:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970382.494919:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.494925:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ee6d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa0c0feea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970382.495058:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11298:x1875871082263424:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 542us (5119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970382.495065:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:3.0:1788970382.496812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.496894:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082263552 00000100:00100000:2.0:1788970382.496904:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082263552 00000100:00100000:2.0:1788970382.496976:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:2.0:1788970382.496988:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11298:x1875871082263552:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970382.497009:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970382.497030:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ee74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d838 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.497061:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.497091:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.497116:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.497233:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ee74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.497252:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.497260:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:2.0:1788970382.497263:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970382.497267:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215bc00, rc 0) 00000100:00100000:2.0:1788970382.497322:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082263552:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 336us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.497329:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:2.0:1788970382.506214:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.506451:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082263808 00000100:00100000:1.0:1788970382.506461:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082263808 00000100:00100000:1.0:1788970382.506561:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:1.0:1788970382.506573:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082263808:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970382.506660:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.506678:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.506689:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970382.507114:0:10102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788970382.507125:0:10102:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401773743075ns, next at 402773740738ns, rc = 0 00000004:00010000:1.0:1788970382.507176:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3c6ea07 reply state 0000000018ee78ad transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.507191:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.507200:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:1.0:1788970382.507202:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788970382.507207:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970382.507559:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11298:x1875871082263808:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 987us (1353us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788970382.507583:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:1.0:1788970382.510221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.510348:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082263936 00000100:00100000:3.0:1788970382.510369:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082263936 00000100:00100000:3.0:1788970382.510457:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:3.0:1788970382.510470:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11298:x1875871082263936:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970382.510496:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970382.510515:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d83f expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.510573:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 17 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.510588:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 17 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.510606:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:3.0:1788970382.510609:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970382.510613:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5e00, rc 0) 00000100:00100000:3.0:1788970382.510787:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+17:11298:x1875871082263936:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 319us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.510794:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:3.0:1788970382.515944:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.516024:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082264064 00000100:00100000:0.0:1788970382.516038:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082264064 00000100:00100000:0.0:1788970382.516103:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1788970382.516112:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875871082264064:12345-192.168.203.15@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788970382.516157:0:10104:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:0.0:1788970382.516186:0:10104:0:(genops.c:1384:class_connect()) connect: client 76727560-d4e0-4213-a4e0-b609fd69db0f, cookie 0xc3abfebe76c6ee90 00002000:00100000:0.0:1788970382.516198:0:10104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76727560-d4e0-4213-a4e0-b609fd69db0f/ffff8a7e844cc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970382.516216:0:10104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788970382.516293:0:10104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970382.516327:0:10104:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3ea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970382.516436:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2399:x1875871082264064:12345-192.168.203.15@tcp:8:lhsmtool_posix.0 Request processed in 323us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970382.516459:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:1.0:1788970382.519183:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.519271:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082264192 00000100:00100000:3.0:1788970382.519284:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082264192 00000100:00100000:3.0:1788970382.519423:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1788970382.519439:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf522580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+6:0:x1875871082264192:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788970382.519943:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788970382.534947:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788970382.534961:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000100:00100000:0.0:1788970382.535098:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf522580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:0:x1875871082264192:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 15660us (15924us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788970382.535109:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:1.0:1788970382.538653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.538832:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082264448 00000100:00100000:0.0:1788970382.538849:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082264448 00000100:00100000:2.0:1788970382.539424:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1788970382.539440:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+17:11298:x1875871082264448:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970382.539676:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11298:x1875871082264448:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 241us (1037us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788970382.540920:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970382.544928:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.545011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082264704 00000100:00100000:2.0:1788970382.545021:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082264704 00000100:00100000:2.0:1788970382.545102:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:2.0:1788970382.545113:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11298:x1875871082264704:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788970382.545218:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11298:x1875871082264704:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 107us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.545226:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:0.0:1788970382.549540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.549610:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082264832 00000100:00100000:1.0:1788970382.549629:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082264832 00000100:00100000:1.0:1788970382.549713:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:1.0:1788970382.549726:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11298:x1875871082264832:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970382.549753:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970382.549782:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d846 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.549873:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ee9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.549894:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.549909:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970382.549967:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970382.549993:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.550026:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6ee97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d846 expref: 20 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.550073:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ee9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d846 expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.550083:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:1.0:1788970382.550087:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788970382.550091:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:1.0:1788970382.550175:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11298:x1875871082264832:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 452us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970382.550183:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:1.0:1788970382.553224:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.553499:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082264960 00000100:00100000:3.0:1788970382.553512:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082264960 00000100:00100000:3.0:1788970382.553627:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:3.0:1788970382.553670:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082264960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970382.553695:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970382.553729:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d84d expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970382.553762:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa1858e, blocks: 0x0 00010000:00010000:3.0:1788970382.553790:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1788970382.553795:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970382.553807:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.553834:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.553852:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4200, rc 0) 00000100:00100000:3.0:1788970382.553932:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082264960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 269us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.553939:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:3.0:1788970382.558079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.558188:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082265216 00000100:00100000:1.0:1788970382.558202:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082265216 00000100:00100000:1.0:1788970382.558287:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 89 00000100:00100000:1.0:1788970382.558299:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11298:x1875871082265216:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970382.558486:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11298:x1875871082265216:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 188us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970382.558495:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 89 00000100:00100000:3.0:1788970382.568109:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.568195:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082265344 00000100:00100000:1.0:1788970382.568214:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082265344 00000100:00100000:1.0:1788970382.568301:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:1.0:1788970382.568314:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:11298:x1875871082265344:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970382.568349:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970382.568422:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d854 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.568486:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.568496:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970382.568502:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970382.568510:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.568557:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.568578:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970382.568597:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf521680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875871102269696:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970382.568721:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970382.571755:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf521680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875871102269696:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970382.571800:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.571825:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:2.0:1788970382.571899:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11298:x1875871082265344:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 3588us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.571909:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:3.0:1788970382.574894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.575047:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082265472 00000100:00100000:2.0:1788970382.575063:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082265472 00010000:00010000:2.0:1788970382.575122:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.575174:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1788970382.575185:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082265472:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970382.575203:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970382.575243:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.575259:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.575309:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea1fbc8/0xc3abfebe76c6eea5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d84d expref: 7 pid: 8440 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.575350:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970382.575355:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970382.575365:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.575376:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.575439:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.575457:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875871102269824:192.168.203.15@tcp:105: 00000100:00100000:2.0:1788970382.575563:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970382.580042:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875871102269824:192.168.203.15@tcp:105: 00010000:00010000:2.0:1788970382.580082:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970382.580147:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082265472:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 4962us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970382.580159:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:3.0:1788970382.589891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.590085:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082265600 00000100:00100000:1.0:1788970382.590098:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082265600 00002000:00100000:1.0:1788970382.590159:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a7ebf5152c0 x1875871082265600/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:158/0 lens 504/0 e 0 to 0 dl 1788970393 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788970382.590172:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7ebf5152c0 with x1875871082265600 ext(0->8) 00002000:00010000:1.0:1788970382.590180:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7ebf5152c0 00000100:00100000:1.0:1788970382.590209:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:1.0:1788970382.590220:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082265600:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788970382.598700:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082265600:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 8462us (8805us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788970382.598728:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00002000:00100000:3.0:1788970382.598747:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a7ebf5152c0 x1875871082265600/t4294967303(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:158/0 lens 504/448 e 0 to 0 dl 1788970393 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970382.598779:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7ebf5152c0 with x1875871082265600 ext(0->8) 00002000:00010000:3.0:1788970382.598787:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7ebf5152c0 00000100:00100000:0.0:1788970382.605709:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.606152:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082265728 00000100:00100000:1.0:1788970382.606163:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082265728 00000100:00100000:1.0:1788970382.606216:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00100000:1.0:1788970382.606228:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11298:x1875871082265728:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788970382.619370:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788970382.619411:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788970382.619433:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788970382.619572:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788970382.619584:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788970382.619594:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970382.619621:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102269952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788970382.619719:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970382.619804:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102269952 00000100:00100000:3.0:1788970382.619813:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102269952 00000100:00100000:3.0:1788970382.619881:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970382.619892:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102269952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788970382.620055:0:8689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788970382.620059:0:8689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788970382 00002000:00010000:3.0:1788970382.620062:0:8689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788970382.620064:0:8689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788970382 -> 1788970382 00002000:00010000:3.0:1788970382.620066:0:8689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788970382.620112:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102269952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (393us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788970382.620119:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1788970382.620168:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7ebf516580/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788970382.620175:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102269952:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788970382.621065:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970382.621225:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:11298:x1875871082265728:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 14993us (15520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970382.621249:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 90 00010000:00010000:0.0:1788970382.622326:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.622353:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.622363:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.622370:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970382.622376:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.622414:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.622436:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:0.0:1788970382.622439:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788970382.622465:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.622473:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6ee82 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970382.628063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.628161:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082265856 00000100:00100000:2.0:1788970382.628175:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082265856 00000100:00100000:2.0:1788970382.628251:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:2.0:1788970382.628283:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082265856:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788970382.634131:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788970382.634151:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788970382.634479:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082265856:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 6188us (6421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.634509:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:1.0:1788970382.649569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.649616:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082266112 00000100:00100000:1.0:1788970382.649629:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082266112 00000100:00100000:1.0:1788970382.649698:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:1.0:1788970382.649710:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf522940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082266112:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970382.649908:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970382.649946:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6ee9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d846 expref: 14 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.649967:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:1.0:1788970382.649975:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970382.650015:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.650034:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.650046:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970382.652941:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003852d4cb reply state 00000000db4d5070 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.652978:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.652989:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:1.0:1788970382.652993:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970382.653000:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970382.653204:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf522940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+15:11298:x1875871082266112:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 3491us (3640us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788970382.653215:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:3.0:1788970382.668097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.669554:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082266240 00000100:00100000:2.0:1788970382.669573:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082266240 00000100:00100000:2.0:1788970382.669653:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:2.0:1788970382.669665:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082266240:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788970382.669886:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788970382.669891:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788970382 -> 1788970381 00002000:00010000:2.0:1788970382.669894:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788970379 00002000:00010000:2.0:1788970382.669896:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788970382 -> 1788970381 00002000:00010000:2.0:1788970382.669899:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788970382.669981:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082266240:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 318us (1900us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788970382.669990:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:0.0:1788970382.672586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970382.673292:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082266496 00000100:00100000:2.0:1788970382.673309:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082266496 00000100:00100000:2.0:1788970382.673443:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00100000:2.0:1788970382.673457:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+15:11298:x1875871082266496:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788970382.673556:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.673579:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.673591:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.673655:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.673672:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 15 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.673691:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102270080:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970382.673811:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970382.680115:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d826f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102270080:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970382.680159:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.681370:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.681701:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082266624 00000100:00100000:1.0:1788970382.681714:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082266624 00010000:00010000:1.0:1788970382.681763:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 16 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970382.681848:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1788970382.681860:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+16:2403:x1875871082266624:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970382.681879:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970382.681888:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 16 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.681904:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 16 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.681933:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ee7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d838 expref: 16 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.681957:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:1.0:1788970382.681964:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.681976:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.681987:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.682065:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970382.682136:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+15:2403:x1875871082266624:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 277us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970382.682145:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00010000:00010000:0.0:1788970382.682287:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682297:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682361:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682369:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682377:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682407:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970382.682413:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682422:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682433:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:0.0:1788970382.682436:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788970382.682440:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.682452:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eeba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.682504:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082266496:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 9051us (9940us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788970382.682513:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00100000:2.0:1788970382.688567:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.694368:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082266752 00000100:00100000:1.0:1788970382.694414:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082266752 00000100:00100000:2.0:1788970382.694683:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1788970382.694697:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082266752:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788970382.694758:0:10104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.694784:0:10104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.694795:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970382.694800:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970382.694806:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.694877:0:10104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.694907:0:10104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 7 pid: 8441 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.694923:0:10104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10104:1875871102270208:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970382.695043:0:10104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970382.706905:0:10104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10104:1875871102270208:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970382.706959:0:10104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970382.708895:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.709580:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082266880 00000100:00100000:3.0:1788970382.709596:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082266880 00010000:00010000:3.0:1788970382.709652:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 8 pid: 8441 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970382.709716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:3.0:1788970382.709730:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082266880:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970382.709749:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970382.709778:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 8 pid: 8441 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.709794:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 8 pid: 8441 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.709824:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6fd6ceb/0xc3abfebe76c6eeac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d854 expref: 8 pid: 8441 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.709847:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970382.709852:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970382.709859:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.709890:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.709971:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970382.710048:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082266880:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 321us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.710057:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00010000:00010000:0.0:1788970382.712685:0:10104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712714:0:10104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712756:0:10104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712766:0:10104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712777:0:10104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712786:0:10104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970382.712792:0:10104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712803:0:10104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712839:0:10104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.712848:0:10104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000054246a2/0xc3abfebe76c6eec1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.713264:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082266752:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 18561us (24703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970382.713277:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:1.0:1788970382.715500:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.715691:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082267136 00000100:00100000:3.0:1788970382.715708:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082267136 00000100:00100000:3.0:1788970382.715790:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 93 00000100:00100000:3.0:1788970382.715803:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11298:x1875871082267136:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788970382.715917:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.715940:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.715953:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.716001:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.716015:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 14 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970382.716032:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836a8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102270336:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970382.716156:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970382.718959:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970382.719078:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836a8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102270336:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970382.719119:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.728344:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082267264 00000100:00100000:0.0:1788970382.728369:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082267264 00010000:00010000:0.0:1788970382.728446:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 15 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.728505:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:0.0:1788970382.728515:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:2403:x1875871082267264:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970382.728537:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970382.728545:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 15 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728560:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 15 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728587:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6ed08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d7dd expref: 15 pid: 6526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728616:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970382.728623:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728634:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728643:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728675:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970382.728749:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+14:2403:x1875871082267264:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 234us (9805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970382.728757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00010000:00010000:0.0:1788970382.728984:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.728994:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.729192:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.729207:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 14 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.729216:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.729249:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 14 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.729272:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 14 pid: 13652 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.729290:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102270464:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970382.729373:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8592d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970382.739008:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970382.739046:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082267392 00000100:00100000:3.0:1788970382.739058:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082267392 00010000:00010000:3.0:1788970382.739112:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 15 pid: 13652 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970382.739157:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:3.0:1788970382.739168:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+15:2402:x1875871082267392:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970382.739964:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970382.739980:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 15 pid: 13652 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.739999:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 15 pid: 13652 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.740032:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:3.0:1788970382.740039:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.740052:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.740061:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.740089:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970382.740163:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+15:2402:x1875871082267392:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 997us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.740202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00010000:00010000:3.0:1788970382.740552:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6ee89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d83f expref: 14 pid: 13652 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970382.740572:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102270464:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970382.740603:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.740615:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970382.740621:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970382.740786:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788970382.740932:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788970382.740977:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788970382.741079:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836ab840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102270592:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970382.741149:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970382.741189:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970382.741216:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102270592 00000100:00100000:3.0:1788970382.741223:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102270592 00000100:00100000:3.0:1788970382.741279:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788970382.741288:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875871102270592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970382.741423:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875871102270592:12345-0@lo:1000:mdt00_001.0 Request processed in 135us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970382.741430:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788970382.741467:0:6525:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788970382.741486:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7ebf516580, transno 4294967304 00000100:00100000:3.0:1788970382.741499:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836ab840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102270592:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788970382.741631:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788970382.741676:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836ab840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102270720:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970382.741708:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970382.741725:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970382.741823:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102270720 00000100:00100000:3.0:1788970382.741828:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102270720 00000100:00100000:3.0:1788970382.741867:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788970382.741884:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1875871102270720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970382.742005:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1875871102270720:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (296us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788970382.742014:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788970382.742049:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836ab840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102270720:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788970382.742109:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742122:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742131:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742137:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970382.742142:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742152:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742171:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:1.0:1788970382.742174:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970382.742180:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742187:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6eecf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742224:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742231:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742237:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742374:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970382.742378:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742411:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742422:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:1.0:1788970382.742425:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970382.742429:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742436:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6edfd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742470:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742486:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 17 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742496:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742529:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 17 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970382.742547:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 17 pid: 10102 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970382.742576:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf521e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102270848:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970382.742723:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970382.746650:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.746707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082267520 00000100:00100000:0.0:1788970382.746722:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082267520 00010000:00010000:0.0:1788970382.746797:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 18 pid: 10102 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970382.746830:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf521e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102270848:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970382.746855:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00010000:00010000:3.0:1788970382.746867:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970382.746869:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2403:x1875871082267520:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970382.746894:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970382.746902:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 18 pid: 10102 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.746916:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 18 pid: 10102 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.746946:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ee19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d823 expref: 18 pid: 10102 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.746966:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970382.746971:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.747005:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.747014:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.747054:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970382.747123:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+17:2403:x1875871082267520:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 257us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970382.747131:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00010000:00010000:2.0:1788970382.749440:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749462:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749480:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749489:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749497:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749505:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.749510:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749519:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749540:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.749544:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970382.749560:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749567:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6eed6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749585:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749592:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749598:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749603:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970382.749606:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749612:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749622:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970382.749625:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970382.749628:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.749634:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6eec8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970382.749902:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11298:x1875871082267136:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 34094us (34410us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788970382.749915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 93 00000020:00080000:2.0:1788970382.749931:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788970382.750087:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970382.750093:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970382.750112:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788970382.750119:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970382.754570:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970382.754747:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082267776 00000100:00100000:0.0:1788970382.754761:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082267776 00000100:00100000:0.0:1788970382.754838:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1788970382.754852:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11298:x1875871082267776:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788970382.755726:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788970382.755873:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788970382.755929:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.755953:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.755970:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.755980:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.755986:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.756001:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970382.756073:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788970382.756214:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11298:x1875871082267776:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1362us (1658us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788970382.756233:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000020:00080000:0.0:1788970382.756241:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788970382.756945:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970382.756957:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.756977:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970382.756982:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.756993:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.757012:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:2.0:1788970382.757015:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788970382.757022:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.757028:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6eedd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970382.757054:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970382.757056:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970382.757058:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970383.027910:0:14217:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970383.027921:0:14217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970383.027955:0:14217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788970383.027967:0:14217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970383.132648:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970383.132671:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf523c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102270976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970383.132742:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133088:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102271104:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133156:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102271616:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133201:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102272128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133225:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133245:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788970383.133250:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133270:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133286:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102271744:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133306:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133320:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102272256:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133350:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133424:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102272128 00000100:00100000:1.0:1788970383.133431:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102272128 00000100:00100000:1.0:1788970383.133473:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271232 00000100:00100000:1.0:1788970383.133476:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271232 00000100:00100000:1.0:1788970383.133486:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271744 00000100:00100000:1.0:1788970383.133488:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271744 00000100:00100000:1.0:1788970383.133500:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102272256 00000100:00100000:1.0:1788970383.133502:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102272256 00000100:00100000:1.0:1788970383.133514:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788970383.133522:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf523840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102272128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133567:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf523840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102272128:12345-0@lo:400:kworker.0 Request processed in 46us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.133574:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788970383.133588:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788970383.133593:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102271232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133614:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102271232:12345-0@lo:400:kworker.0 Request processed in 21us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.133619:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788970383.133628:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788970383.133632:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102271744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133652:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102271744:12345-0@lo:400:kworker.0 Request processed in 19us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.133657:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788970383.133665:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788970383.133670:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf521a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102272256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133689:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf521a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102272256:12345-0@lo:400:kworker.0 Request processed in 19us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.133703:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1788970383.133738:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970383.133741:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970383.133751:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102271360:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133772:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133787:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102271872:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133816:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102272384:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133859:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133884:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788970383.133891:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133926:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102272000:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.133945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133958:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf521e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102272512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970383.133975:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970383.133998:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271616 00000100:00100000:1.0:1788970383.134002:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271616 00000100:00100000:1.0:1788970383.134027:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271360 00000100:00100000:1.0:1788970383.134030:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271360 00000100:00100000:1.0:1788970383.134044:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788970383.134050:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102271616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134080:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf522d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102271616:12345-0@lo:400:kworker.0 Request processed in 31us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.134084:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788970383.134105:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788970383.134110:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102271360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134141:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102271360:12345-0@lo:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.134147:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788970383.134160:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271872 00000100:00100000:1.0:1788970383.134163:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271872 00000100:00100000:1.0:1788970383.134182:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271488 00000100:00100000:1.0:1788970383.134184:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271488 00000100:00100000:1.0:1788970383.134194:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788970383.134199:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102271872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134223:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf521680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102271872:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.134229:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788970383.134238:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788970383.134242:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102271488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134261:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102271488:12345-0@lo:400:kworker.0 Request processed in 19us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.134267:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1788970383.134276:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970383.134300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134309:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102271744:0@lo:400:kworker.0 00010000:00080000:1.0:1788970383.134320:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83e86580 x1875871102272256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970383.134342:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102272256:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134363:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102271616:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134371:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102272128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788970383.134432:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102271360:0@lo:400:kworker.0 00010000:00080000:1.0:1788970383.134440:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf3743c0 x1875871102271872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970383.134449:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102271872:0@lo:400:kworker.0 00000100:00100000:2.0:1788970383.134586:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102272384 00000100:00100000:2.0:1788970383.134590:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102272384 00000100:00100000:2.0:1788970383.134629:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102272000 00000100:00100000:2.0:1788970383.134632:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102272000 00000100:00100000:2.0:1788970383.134648:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788970383.134656:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102272384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970383.134701:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102272384:12345-0@lo:400:kworker.0 Request processed in 47us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.134707:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788970383.134719:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788970383.134725:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102272000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970383.134746:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102272000:12345-0@lo:400:kworker.0 Request processed in 22us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.134752:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788970383.134766:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102270976 00000100:00100000:2.0:1788970383.134768:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102270976 00000100:00100000:2.0:1788970383.134787:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102272512 00000100:00100000:2.0:1788970383.134789:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102272512 00000100:00100000:2.0:1788970383.134799:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788970383.134804:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102270976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970383.134825:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970383.134868:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102270976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.134873:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788970383.134884:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788970383.134890:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102272512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970383.134899:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970383.134919:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102272512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.134924:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788970383.134963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102272000:0@lo:400:kworker.0 00000100:00100000:2.0:1788970383.134978:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf521e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102272512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970383.134995:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102272384:0@lo:400:kworker.0 00000100:00100000:2.0:1788970383.135008:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf523c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102270976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970383.135140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102271104 00000100:00100000:0.0:1788970383.135145:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102271104 00000100:00100000:0.0:1788970383.135173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788970383.135179:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102271104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970383.135216:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102271104:12345-0@lo:400:kworker.0 Request processed in 37us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.135222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:1.0:1788970383.135291:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970383.135295:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970383.135312:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102271104:0@lo:400:kworker.0 00000100:00100000:2.0:1788970383.136047:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970383.136112:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082268032 00000100:00100000:1.0:1788970383.136117:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082268032 00000100:00100000:1.0:1788970383.136180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:1.0:1788970383.136188:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+18:11308:x1875871082268032:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970383.136204:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970383.136225:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6eee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d85b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.136342:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6eeeb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.136358:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6eeeb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.136370:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6eeeb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970383.136414:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788970383.136520:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6eee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d85b expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.136537:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6eeeb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d85b expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.136545:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970383.136548:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970383.136552:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:1.0:1788970383.136595:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11308:x1875871082268032:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 408us (551us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788970383.136601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00080000:2.0:1788970383.136666:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970383.153070:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.153144:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082268160 00000100:00100000:2.0:1788970383.153153:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082268160 00000100:00100000:2.0:1788970383.153214:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:2.0:1788970383.153225:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11308:x1875871082268160:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:2.0:1788970383.153301:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153319:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153340:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153356:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153362:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153367:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153476:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153485:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153501:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970383.153545:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153557:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153563:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153569:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153575:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.153579:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153586:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153597:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970383.153600:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970383.153605:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153612:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6eef9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153625:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153637:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153643:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153647:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.153650:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153656:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153663:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823e8900) 00010000:00010000:2.0:1788970383.153665:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970383.153667:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153672:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153686:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153692:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153697:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153701:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.153709:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153714:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153721:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:2.0:1788970383.153723:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970383.153726:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.153731:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.153803:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11308:x1875871082268160:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 579us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.153811:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:3.0:1788970383.182074:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.182511:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082268416 00000100:00100000:2.0:1788970383.182521:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082268416 00000100:00100000:2.0:1788970383.182582:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:2.0:1788970383.182592:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11311:x1875871082268416:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970383.182613:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970383.182633:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d862 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182700:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182715:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182740:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182753:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182761:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182775:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182879:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182888:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182895:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970383.182904:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788970383.182970:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182977:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182985:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.182991:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.183000:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183008:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183019:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970383.183022:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970383.183026:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183033:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183044:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183050:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183056:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183061:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.183064:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183070:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183076:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823e8c00) 00010000:00010000:2.0:1788970383.183078:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970383.183084:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183091:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183126:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6ef0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 23 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183140:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 22 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.183148:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970383.183151:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970383.183153:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b800, rc 0) 00000100:00100000:2.0:1788970383.183204:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11311:x1875871082268416:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 614us (1139us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788970383.183211:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:2.0:1788970383.188438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.195605:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082268544 00000100:00100000:0.0:1788970383.195652:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082268544 00000100:00100000:0.0:1788970383.195726:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:0.0:1788970383.195737:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11311:x1875871082268544:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:0.0:1788970383.195805:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195824:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195836:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195891:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195899:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195907:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195913:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.195918:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195927:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195940:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.195943:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970383.195948:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.195954:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970383.196037:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11311:x1875871082268544:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 301us (7607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.196046:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:2.0:1788970383.207082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.207122:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082268800 00000100:00100000:2.0:1788970383.207132:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082268800 00000100:00100000:2.0:1788970383.207187:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:2.0:1788970383.207197:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11311:x1875871082268800:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970383.208434:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:11311:x1875871082268800:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 1232us (1354us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788970383.208446:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970383.255511:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970383.255569:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269056 00000100:00100000:1.0:1788970383.255581:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269056 00000100:00100000:1.0:1788970383.255646:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 98 00000100:00100000:1.0:1788970383.255657:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:10836:x1875871082269056:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970383.255688:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970383.255709:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ef38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d869 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.255853:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.255871:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 24 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.255901:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.255939:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 24 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.255954:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 24 pid: 13652 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970383.255969:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102272640:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970383.256067:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970383.260584:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102272640:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970383.260615:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970383.266600:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970383.266956:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269184 00000100:00100000:3.0:1788970383.266971:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269184 00010000:00010000:3.0:1788970383.267028:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 25 pid: 13652 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970383.267100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:3.0:1788970383.267111:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+25:2402:x1875871082269184:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970383.267130:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970383.267139:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 25 pid: 13652 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.267153:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 25 pid: 13652 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.267188:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6ef23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d862 expref: 25 pid: 13652 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.267213:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:3.0:1788970383.267220:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.267287:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.267296:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.267354:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970383.267481:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.267510:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970383.267546:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788970383.267697:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6ef38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.267730:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.267740:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.267743:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970383.267748:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:3.0:1788970383.267836:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+25:2402:x1875871082269184:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 722us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970383.267846:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:0.0:1788970383.267921:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:10836:x1875871082269056:12345-192.168.203.15@tcp:101:bash.0 Request processed in 12263us (12416us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788970383.267932:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 98 00000100:00100000:1.0:1788970383.273504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.273787:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269312 00000100:00100000:2.0:1788970383.273824:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269312 00000100:00100000:2.0:1788970383.273892:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:2.0:1788970383.273902:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+24:10836:x1875871082269312:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970383.273926:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970383.273946:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d870 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.273981:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.273994:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.274006:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.274117:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6ef4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d870 expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.274138:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d870 expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.274146:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970383.274149:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970383.274153:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215ae00, rc 0) 00000100:00100000:2.0:1788970383.274218:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+25:10836:x1875871082269312:12345-192.168.203.15@tcp:101:bash.0 Request processed in 317us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.274237:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:2.0:1788970383.279714:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.280265:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269568 00000100:00100000:0.0:1788970383.280275:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269568 00000100:00100000:0.0:1788970383.280348:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:0.0:1788970383.280358:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+25:10836:x1875871082269568:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:0.0:1788970383.280619:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.280639:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.280651:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970383.280707:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788970383.280731:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093395a30 reply state 00000000d1f46dcd transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.280744:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.280751:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.280754:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970383.280758:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788970383.280794:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788970383.280888:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+29:10836:x1875871082269568:12345-192.168.203.15@tcp:36:bash.0 Request processed in 531us (1182us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788970383.280895:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 100 00000020:00080000:0.0:1788970383.280899:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788970383.291947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.292466:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269696 00000100:00100000:0.0:1788970383.292481:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269696 00000100:00100000:0.0:1788970383.292556:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:0.0:1788970383.292568:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+29:10836:x1875871082269696:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970383.292594:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.292615:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ef62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d877 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.292679:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ef62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d877 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.292696:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ef62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d877 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.292739:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.292743:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970383.292748:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013200, rc 0) 00000100:00100000:0.0:1788970383.292820:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+30:10836:x1875871082269696:12345-192.168.203.15@tcp:101:bash.0 Request processed in 254us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.292827:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:1.0:1788970383.297107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.297203:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269824 00000100:00100000:0.0:1788970383.297213:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269824 00000100:00100000:0.0:1788970383.297274:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:0.0:1788970383.297284:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+6:10836:x1875871082269824:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970383.297301:0:10104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.297321:0:10104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d87e expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970383.297355:0:10104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa1858d, atime: 0x6aa1858b, ctime: 0x6aa1858d, blocks: 0x8 00010000:00010000:0.0:1788970383.297377:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788970383.297416:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970383.297425:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 7 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.297442:0:10104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 7 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.297454:0:10104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012400, rc 0) 00000100:00100000:0.0:1788970383.297510:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:10836:x1875871082269824:12345-192.168.203.15@tcp:101:bash.0 Request processed in 227us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.297530:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:3.0:1788970383.302977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.304994:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082269952 00000100:00100000:0.0:1788970383.305010:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082269952 00002000:00010000:0.0:1788970383.305058:0:8445:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788970383.305063:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d836a8000 with x1875871082269952 ext(0->18446744073709551615) 00002000:00010000:0.0:1788970383.305075:0:8445:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d836a8000. 00000100:00100000:0.0:1788970383.305117:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:0.0:1788970383.305128:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082269952:12345-192.168.203.15@tcp:10:bash.0 00002000:00010000:0.0:1788970383.305438:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788970383.305442:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788970381 -> 1788970383 00002000:00010000:0.0:1788970383.305444:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788970379 -> 1788970379 00002000:00010000:0.0:1788970383.305446:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788970381 -> 1788970383 00002000:00010000:0.0:1788970383.305448:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788970383.305502:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082269952:12345-192.168.203.15@tcp:10:bash.0 Request processed in 376us (2535us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788970383.305510:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00002000:00010000:0.0:1788970383.305514:0:8445:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788970383.305517:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d836a8000 with x1875871082269952 ext(0->18446744073709551615) 00002000:00010000:0.0:1788970383.305522:0:8445:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d836a8000. 00010000:00010000:1.0:1788970383.388604:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970383.388870:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.388929:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082270080 00000100:00100000:0.0:1788970383.388939:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082270080 00000100:00100000:0.0:1788970383.389034:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:0.0:1788970383.389045:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11325:x1875871082270080:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1788970383.389114:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389148:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389159:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389174:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389180:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389186:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389257:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389266:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389273:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970383.389317:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389337:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389344:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389360:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389365:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.389369:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389376:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389423:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970383.389426:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.389431:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389438:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389453:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389459:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389464:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389469:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.389472:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389489:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389497:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d8335f300) 00010000:00010000:0.0:1788970383.389499:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.389502:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389508:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389523:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389530:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389535:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389540:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.389542:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389547:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389554:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.389556:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.389558:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.389573:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970383.389648:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11325:x1875871082270080:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 605us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.390004:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:1.0:1788970383.457471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.457546:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082270336 00000100:00100000:0.0:1788970383.457556:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082270336 00000100:00100000:0.0:1788970383.457616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 103 00000100:00100000:0.0:1788970383.457626:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11328:x1875871082270336:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970383.457655:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.457679:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d885 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457752:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457767:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457778:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457792:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457798:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457823:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457934:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ef9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457943:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.457951:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970383.457960:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788970383.458039:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458048:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458055:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458061:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.458065:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458072:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458084:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970383.458087:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.458098:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458105:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6ef8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458119:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458126:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458132:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458138:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.458141:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458147:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458155:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d8335f300) 00010000:00010000:0.0:1788970383.458157:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.458160:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458166:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6ef93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458205:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6ef85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d885 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458233:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ef9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d885 expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.458240:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.458243:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788970383.458245:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012600, rc 0) 00000100:00100000:0.0:1788970383.458314:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11328:x1875871082270336:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 688us (850us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788970383.458321:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 103 00000100:00100000:3.0:1788970383.461645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.461741:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082270464 00000100:00100000:2.0:1788970383.461751:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082270464 00000100:00100000:2.0:1788970383.461820:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 104 00000100:00100000:2.0:1788970383.461832:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11328:x1875871082270464:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1788970383.461902:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.461919:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.461929:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.461963:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.461979:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 32 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.461993:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102272768:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970383.462084:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8133a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970383.471676:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970383.471981:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082270720 00000100:00100000:3.0:1788970383.471992:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082270720 00000100:00100000:3.0:1788970383.472062:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:3.0:1788970383.472073:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+33:6171:x1875871082270720:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788970383.472428:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+34:6171:x1875871082270720:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 356us (774us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788970383.472436:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1788970383.477885:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.478060:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082270848 00000100:00100000:0.0:1788970383.478072:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082270848 00010000:00010000:0.0:1788970383.478117:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 34 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970383.478162:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:0.0:1788970383.478174:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+34:2400:x1875871082270848:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970383.478191:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970383.478198:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 34 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.478214:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 34 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.478252:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.478257:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.478282:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.478290:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.478337:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970383.478432:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+34:2400:x1875871082270848:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 260us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.478440:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00010000:00010000:2.0:1788970383.481510:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6ef3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d869 expref: 33 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.481538:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102272768:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970383.481570:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481603:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481609:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481861:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481869:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481876:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481882:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.481886:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481893:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481908:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970383.481911:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970383.481915:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.481920:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.482062:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11328:x1875871082270464:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 20232us (20425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.482079:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 104 00000100:00100000:1.0:1788970383.485795:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970383.485892:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082271104 00000100:00100000:3.0:1788970383.485903:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082271104 00000100:00100000:3.0:1788970383.486003:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:3.0:1788970383.486015:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+32:11328:x1875871082271104:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970383.486244:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+33:11328:x1875871082271104:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 230us (456us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788970383.486252:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1788970383.582110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.583012:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082271360 00000100:00100000:0.0:1788970383.583024:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082271360 00000100:00100000:0.0:1788970383.583090:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:0.0:1788970383.583101:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+33:11339:x1875871082271360:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:0.0:1788970383.583128:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.583151:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6efaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d88c expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583228:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583241:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583252:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583264:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583289:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583295:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583630:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6efc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583640:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583647:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6efc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970383.583657:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788970383.583736:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583744:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583751:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583756:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.583760:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583767:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583788:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970383.583791:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.583797:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583803:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6efb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583815:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583821:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583826:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583831:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970383.583833:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583839:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583845:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d8335f300) 00010000:00010000:0.0:1788970383.583847:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970383.583849:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583854:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6efbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583905:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6efaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d88c expref: 36 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583919:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6efc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d88c expref: 35 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.583926:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:0.0:1788970383.583928:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970383.583931:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013800, rc 0) 00000100:00100000:0.0:1788970383.583986:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11339:x1875871082271360:12345-192.168.203.15@tcp:101:cat.0 Request processed in 887us (1886us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788970383.583995:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:1.0:1788970383.591364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.591444:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082271616 00000100:00100000:0.0:1788970383.591455:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082271616 00000100:00100000:0.0:1788970383.591517:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:0.0:1788970383.591528:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11339:x1875871082271616:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:0.0:1788970383.591883:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+36:11339:x1875871082271616:12345-192.168.203.15@tcp:35:cat.0 Request processed in 355us (530us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788970383.591891:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1788970383.625204:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970383.625352:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082271872 00000100:00100000:3.0:1788970383.625363:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082271872 00000100:00100000:3.0:1788970383.625452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 106 00000100:00100000:3.0:1788970383.625463:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+36:11340:x1875871082271872:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:3.0:1788970383.625515:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788970383.625541:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6ef62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d877 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625563:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6efc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d88c expref: 35 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625593:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6ef9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d885 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625606:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6ef54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d870 expref: 33 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625618:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:3.0:1788970383.625623:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970383.625643:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625656:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625666:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625680:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625687:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625694:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625791:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625800:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.625814:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970383.626025:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788970383.626035:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402892653092ns, next at 403892650772ns, rc = 0 00010000:00010000:3.0:1788970383.626079:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626088:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626096:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626103:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626110:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626117:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626142:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970383.626159:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626166:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626172:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626185:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970383.626189:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626199:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626208:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:3.0:1788970383.626211:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788970383.626215:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626220:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6efe0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626246:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626252:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626258:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626263:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970383.626266:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626272:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626290:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:3.0:1788970383.626292:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970383.626295:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626301:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6efd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970383.626312:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056d26154 reply state 0000000079e46c56 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626322:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.626338:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:3.0:1788970383.626340:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970383.626342:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970383.626450:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+34:11340:x1875871082271872:12345-192.168.203.15@tcp:36:rm.0 Request processed in 987us (1254us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788970383.626457:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 106 00010000:00010000:2.0:1788970383.627659:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970383.627670:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.627679:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970383.627684:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.627692:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.627706:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:2.0:1788970383.627709:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788970383.627712:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.627718:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6efe7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.627732:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970383.627734:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970383.627735:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970383.667481:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.668038:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082272128 00000100:00100000:2.0:1788970383.668049:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082272128 00000100:00100000:2.0:1788970383.668119:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:2.0:1788970383.668130:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+34:11346:x1875871082272128:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970383.668154:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970383.668177:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d893 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668307:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668334:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668347:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668359:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668368:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668375:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970383.668813:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788970383.668949:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668959:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.668967:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669002:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669021:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669029:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669035:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.669039:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669047:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669060:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970383.669063:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970383.669068:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669074:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6eff5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970383.669090:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086c41bdb reply state 00000000f03099d9 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669100:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669106:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:2.0:1788970383.669109:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970383.669112:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788970383.669141:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6efee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669164:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.669171:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:2.0:1788970383.669174:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970383.669176:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b800, rc 0) 00000100:00100000:2.0:1788970383.669261:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+37:11346:x1875871082272128:12345-192.168.203.15@tcp:101:bash.0 Request processed in 1133us (1789us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788970383.669269:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:2.0:1788970383.674901:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970383.675051:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082272256 00000100:00100000:3.0:1788970383.675062:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082272256 00000100:00100000:3.0:1788970383.675136:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:3.0:1788970383.675147:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082272256:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970383.675167:0:8689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970383.675192:0:8689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d89a expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970383.675220:0:8689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970383.675271:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1788970383.675275:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970383.675286:0:8689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 8 pid: 8689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.675308:0:8689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 8 pid: 8689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970383.675341:0:8689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4400, rc 0) 00000100:00100000:3.0:1788970383.675436:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082272256:12345-192.168.203.15@tcp:101:bash.0 Request processed in 291us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970383.675444:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00080000:2.0:1788970383.675684:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970383.684650:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.684751:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082272384 00000100:00100000:0.0:1788970383.684762:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082272384 00000100:00100000:0.0:1788970383.684821:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:0.0:1788970383.684832:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:11346:x1875871082272384:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970383.684850:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.684868:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8a1 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.684914:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.684924:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970383.684928:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970383.684933:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.684968:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.684981:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970383.685009:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875871102272896:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970383.685099:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8215dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970383.687772:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875871102272896:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970383.687811:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.687832:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013600, rc 0) 00000100:00100000:0.0:1788970383.687895:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:11346:x1875871082272384:12345-192.168.203.15@tcp:101:bash.0 Request processed in 3063us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.687905:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:3.0:1788970383.688599:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970383.688785:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082272512 00000100:00100000:1.0:1788970383.688793:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082272512 00010000:00010000:1.0:1788970383.688830:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970383.688884:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:1.0:1788970383.688894:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082272512:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970383.688908:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970383.688928:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.688941:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.688964:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012430f4a/0xc3abfebe76c6f011 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d89a expref: 9 pid: 8689 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.688979:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970383.688983:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970383.688999:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.689009:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.689043:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970383.689057:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e0b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1875871102273024:192.168.203.15@tcp:105: 00000100:00100000:1.0:1788970383.689136:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970383.694527:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e0b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1875871102273024:192.168.203.15@tcp:105: 00010000:00010000:1.0:1788970383.694560:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970383.694634:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082272512:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 5739us (6036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.694648:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1788970383.695689:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.698168:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082272768 00000100:00100000:0.0:1788970383.698186:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082272768 00000100:00100000:0.0:1788970383.698321:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970383.698343:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+37:11346:x1875871082272768:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:0.0:1788970383.700087:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11346:x1875871082272768:12345-192.168.203.15@tcp:35:bash.0 Request processed in 1496us (4152us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788970383.700103:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1788970383.897822:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.898001:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082272896 00000100:00100000:0.0:1788970383.898022:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082272896 00000100:00100000:0.0:1788970383.898092:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00100000:0.0:1788970383.898106:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+38:11362:x1875871082272896:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970383.898138:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.898163:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f01f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8a8 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.898231:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.898246:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.898260:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970383.898306:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788970383.898310:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970383.898341:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.898366:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f01f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a8 expref: 40 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.898470:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a8 expref: 39 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.898479:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970383.898482:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970383.898486:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012a00, rc 0) 00000100:00100000:0.0:1788970383.898562:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+39:11362:x1875871082272896:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 460us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.898571:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00100000:3.0:1788970383.901863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.902020:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082273152 00000100:00100000:0.0:1788970383.902032:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082273152 00000100:00100000:0.0:1788970383.902140:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 109 00000100:00100000:0.0:1788970383.902153:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+39:11362:x1875871082273152:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970383.902180:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.902204:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f02d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8af expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.902448:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.902464:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.902476:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970383.902489:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788970383.902651:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f02d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8af expref: 42 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.902673:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8af expref: 41 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.902683:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:0.0:1788970383.902686:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970383.902690:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013800, rc 0) 00000100:00100000:0.0:1788970383.902766:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+41:11362:x1875871082273152:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 615us (912us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788970383.902774:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 109 00000100:00100000:3.0:1788970383.914107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970383.914161:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970383.914259:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082273408 00000100:00100000:1.0:1788970383.914271:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082273408 00000100:00100000:1.0:1788970383.914348:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 110 00000100:00100000:1.0:1788970383.914359:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+41:11362:x1875871082273408:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970383.914409:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970383.914432:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f042 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8b6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.914538:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.914555:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.914567:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970383.914579:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788970383.914683:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f042 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8b6 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.914702:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8b6 expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.914724:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:1.0:1788970383.914727:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788970383.914730:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:1.0:1788970383.914797:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+43:11362:x1875871082273408:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 432us (693us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788970383.914804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 110 00000100:00100000:0.0:1788970383.916719:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082273536 00000100:00100000:0.0:1788970383.916735:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082273536 00000100:00100000:0.0:1788970383.916808:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1788970383.916818:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+43:2401:x1875871082273536:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970383.916833:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970383.916854:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8af expref: 43 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.916871:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:0.0:1788970383.916875:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970383.916936:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+42:2401:x1875871082273536:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 119us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.916943:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1788970383.919349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.919548:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082273664 00000100:00100000:2.0:1788970383.919558:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082273664 00000100:00100000:2.0:1788970383.919618:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:2.0:1788970383.919628:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082273664:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:2.0:1788970383.919674:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.919694:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.919703:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788970383.919707:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970383.919725:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.919759:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.919774:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 8 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.919801:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8441:1875871102273152:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970383.919934:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8133a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788970383.930054:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8441:1875871102273152:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970383.930087:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970383.932549:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.932639:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082273792 00000100:00100000:0.0:1788970383.932650:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082273792 00002000:00100000:0.0:1788970383.932715:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a7d836a8f00 x1875871082273792/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:159/0 lens 504/0 e 0 to 0 dl 1788970394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970383.932727:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d836a8f00 with x1875871082273792 ext(0->8) 00010000:00010000:0.0:1788970383.932737:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 9 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.932754:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 9 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970383.932762:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7d836a8f00 00000100:00100000:0.0:1788970383.932799:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:0.0:1788970383.932808:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082273792:12345-192.168.203.15@tcp:4:lfs.0 00000100:00100000:0.0:1788970383.933884:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+11:2402:x1875871082273792:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 1072us (1340us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788970383.933895:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00002000:00100000:0.0:1788970383.933905:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a7d836a8f00 x1875871082273792/t4294967303(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:159/0 lens 504/448 e 0 to 0 dl 1788970394 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970383.933915:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d836a8f00 with x1875871082273792 ext(0->8) 00010000:00010000:0.0:1788970383.933924:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.933940:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970383.933947:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7d836a8f00 00000100:00100000:3.0:1788970383.940054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.940209:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082273920 00000100:00100000:0.0:1788970383.940226:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082273920 00010000:00010000:0.0:1788970383.940282:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970383.940346:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:0.0:1788970383.940358:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+11:2403:x1875871082273920:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970383.940376:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788970383.940429:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788970383.940432:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788970383 00002000:00010000:0.0:1788970383.940435:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788970383 00002000:00010000:0.0:1788970383.940437:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788970383 00002000:00010000:0.0:1788970383.940440:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788970383.940447:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.940464:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.940487:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff37314/0xc3abfebe76c6f018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a1 expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.940505:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970383.940509:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970383.940515:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.940545:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.940572:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970383.940633:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2403:x1875871082273920:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 278us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.940641:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00010000:00010000:2.0:1788970383.940816:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940827:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940861:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940870:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940891:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940898:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970383.940903:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940912:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940925:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.940932:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0096da7/0xc3abfebe76c6f057 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.940981:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2403:x1875871082273664:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 21354us (21639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970383.940990:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1788970383.949057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970383.949485:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082274176 00000100:00100000:2.0:1788970383.949502:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082274176 00000100:00100000:2.0:1788970383.949581:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:2.0:1788970383.949593:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+42:11362:x1875871082274176:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:2.0:1788970383.949662:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8b6 expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970383.949914:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788970383.949951:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788970383.950290:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788970383.950343:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.950359:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.950368:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.950459:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.950475:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 46 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.950489:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875871102273280:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970383.950578:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970383.954971:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970383.955741:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082274304 00000100:00100000:1.0:1788970383.955756:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082274304 00010000:00010000:1.0:1788970383.955806:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 47 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970383.955864:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:1.0:1788970383.955874:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+47:2402:x1875871082274304:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970383.955889:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970383.955895:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 47 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.955909:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 47 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.955931:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:1.0:1788970383.955937:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.955946:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.955971:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970383.955994:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970383.956062:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+47:2402:x1875871082274304:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 189us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970383.956069:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00010000:00010000:2.0:1788970383.956981:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f003 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d893 expref: 46 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.957072:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875871102273280:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970383.957104:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.957128:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.957135:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970383.957236:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788970383.957369:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788970383.957991:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102273408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788970383.958206:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970383.958254:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8133a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970383.958410:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102273408 00000100:00100000:3.0:1788970383.958416:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102273408 00000100:00100000:3.0:1788970383.958462:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788970383.958472:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1875871102273408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788970383.958558:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1875871102273408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970383.958575:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788970383.959197:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102273408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788970383.959318:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788970383.959948:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102273536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788970383.959998:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970383.961158:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970383.961994:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102273536 00000100:00100000:3.0:1788970383.962073:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102273536 00000100:00100000:3.0:1788970383.962142:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788970383.962151:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6527:x1875871102273536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788970383.962351:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6527:x1875871102273536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 201us (2353us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788970383.962359:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788970383.962753:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102273536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788970383.962830:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788970383.962882:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.962892:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.962900:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.962905:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970383.962921:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.962929:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.963061:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:2.0:1788970383.963064:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788970383.963069:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970383.963076:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f05e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970383.963177:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788970383.963238:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788970383.963250:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403229868302ns, next at 404229865982ns, rc = 0 00000001:00080000:2.0:1788970383.963256:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788970383.963279:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d823e8c00) 00010000:00010000:2.0:1788970383.963282:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788970383.963288:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f049 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8b6 expref: 50 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970383.963505:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+49:11362:x1875871082274176:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 13913us (14463us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788970383.963514:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000020:00080000:2.0:1788970383.963519:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788970383.967860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.967943:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082274432 00000100:00100000:0.0:1788970383.967953:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082274432 00000100:00100000:0.0:1788970383.968012:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 111 00000100:00100000:0.0:1788970383.968021:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+49:11362:x1875871082274432:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970383.968045:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970383.968066:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f065 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8bd expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.968118:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f065 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8bd expref: 50 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.968132:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f065 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8bd expref: 50 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970383.968148:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970383.968151:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970383.968154:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013600, rc 0) 00000100:00100000:0.0:1788970383.968208:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+50:11362:x1875871082274432:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 188us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970383.968238:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 111 00000100:00100000:3.0:1788970383.972772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970383.973122:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082274688 00000100:00100000:0.0:1788970383.973132:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082274688 00000100:00100000:0.0:1788970383.973197:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:0.0:1788970383.973207:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+50:11362:x1875871082274688:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970383.973615:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+51:11362:x1875871082274688:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 407us (851us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788970383.973623:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:1.0:1788970384.071350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.071586:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082274816 00000100:00100000:0.0:1788970384.071599:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082274816 00000100:00100000:0.0:1788970384.072087:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 112 00000100:00100000:0.0:1788970384.072102:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+51:11372:x1875871082274816:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:0.0:1788970384.072208:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072241:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072256:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072271:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072290:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072297:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072456:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072465:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072473:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970384.072540:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072557:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072564:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072572:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072579:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970384.072583:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072592:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072605:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970384.072608:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970384.072615:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072627:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f06c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072643:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072649:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072655:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072660:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970384.072673:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072679:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072686:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:0.0:1788970384.072689:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970384.072692:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072699:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f073 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072709:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072715:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072733:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072739:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970384.072742:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072748:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072755:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970384.072757:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970384.072760:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.072766:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f07a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970384.072859:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+51:11372:x1875871082274816:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 761us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970384.072867:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 112 00000100:00100000:3.0:1788970384.111788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.111965:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082275072 00000100:00100000:1.0:1788970384.111978:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082275072 00000100:00100000:1.0:1788970384.112050:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:1.0:1788970384.112062:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+51:11375:x1875871082275072:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970384.112089:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.112116:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f081 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8c4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112212:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112231:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112244:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112262:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112270:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112300:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112488:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112497:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112505:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970384.112516:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788970384.112605:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112612:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112618:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112625:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970384.112629:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112637:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112650:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970384.112653:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970384.112665:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112672:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f088 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112685:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112691:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112696:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112701:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970384.112704:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112709:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112716:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:1.0:1788970384.112718:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970384.112721:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.112727:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f08f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.113028:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f081 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.113058:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.113066:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.113068:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970384.113072:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:1.0:1788970384.113160:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+53:11375:x1875871082275072:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1099us (1386us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788970384.113168:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:1.0:1788970384.119034:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.119845:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082275200 00000100:00100000:2.0:1788970384.119862:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082275200 00000100:00100000:2.0:1788970384.120026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:2.0:1788970384.120039:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+53:11375:x1875871082275200:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1788970384.120454:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.120730:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.120813:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.120867:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.120877:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.120953:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.121131:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970384.121136:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.121145:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.121159:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.121163:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970384.121168:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.121175:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.121812:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+53:11375:x1875871082275200:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 1768us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.121825:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:3.0:1788970384.127666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.127713:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082275456 00000100:00100000:2.0:1788970384.127727:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082275456 00000100:00100000:2.0:1788970384.127810:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:2.0:1788970384.127822:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+53:11375:x1875871082275456:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970384.128306:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11375:x1875871082275456:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 485us (653us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788970384.128315:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1788970384.210773:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.210868:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082275712 00000100:00100000:2.0:1788970384.210882:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082275712 00000100:00100000:2.0:1788970384.210964:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:2.0:1788970384.210977:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11385:x1875871082275712:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970384.211009:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970384.211013:0:13652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970384.211047:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8a8 expref: 54 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.211087:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970384.211094:0:13652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970384.211112:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8cb expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.211253:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.211287:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.211296:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.211348:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.211365:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 54 pid: 6525 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.211530:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102273664:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970384.211665:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970384.219693:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.219849:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102273664:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970384.219887:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970384.219963:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082275840 00000100:00100000:0.0:1788970384.219972:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082275840 00010000:00010000:0.0:1788970384.220029:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 55 pid: 6525 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.223749:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1788970384.226196:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+55:2403:x1875871082275840:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970384.226233:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.226249:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 55 pid: 6525 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.226344:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 55 pid: 6525 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.226396:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f096 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8c4 expref: 55 pid: 6525 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.226421:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.226428:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.226652:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.226663:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.226715:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970384.226813:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+54:2403:x1875871082275840:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 718us (7134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.226823:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00010000:00010000:2.0:1788970384.226939:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.226949:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970384.226974:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788970384.227754:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 55 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.227801:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 54 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.227810:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.227814:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970384.227817:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b800, rc 0) 00000100:00100000:2.0:1788970384.227862:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11385:x1875871082275712:12345-192.168.203.15@tcp:101:bash.0 Request processed in 16888us (17110us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788970384.227872:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:3.0:1788970384.229505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.229741:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082275968 00000100:00100000:1.0:1788970384.229755:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082275968 00000100:00100000:1.0:1788970384.229824:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:1.0:1788970384.229839:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+54:11385:x1875871082275968:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970384.229869:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.229895:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f0c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8d2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.229942:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.229960:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.229973:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.230128:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f0c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.230171:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.230182:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.230185:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970384.230190:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:1.0:1788970384.230740:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+55:11385:x1875871082275968:12345-192.168.203.15@tcp:101:bash.0 Request processed in 902us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.230750:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:0.0:1788970384.235669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.235726:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082276224 00000100:00100000:2.0:1788970384.235740:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082276224 00000100:00100000:2.0:1788970384.235822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:2.0:1788970384.235837:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+55:11385:x1875871082276224:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:2.0:1788970384.236207:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.236230:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.236246:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970384.236485:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788970384.236513:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfca47ec reply state 00000000deb65c99 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.236528:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.236557:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.236560:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970384.236566:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970384.236691:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11385:x1875871082276224:12345-192.168.203.15@tcp:36:bash.0 Request processed in 858us (1037us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788970384.236699:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000020:00080000:2.0:1788970384.236705:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970384.242509:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.242781:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082276352 00000100:00100000:2.0:1788970384.242795:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082276352 00000100:00100000:2.0:1788970384.242871:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:2.0:1788970384.242881:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11385:x1875871082276352:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970384.242915:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970384.242940:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8d9 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.243073:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.243090:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 59 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.243101:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.243143:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 59 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.243159:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 59 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.243193:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102273792:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970384.243367:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970384.246186:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102273792:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970384.246232:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970384.247181:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.248703:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082276480 00000100:00100000:1.0:1788970384.248722:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082276480 00010000:00010000:1.0:1788970384.248788:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 60 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.248832:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:1.0:1788970384.248845:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+60:2403:x1875871082276480:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970384.248866:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.248875:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 60 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.248891:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 60 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.248920:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8cb expref: 60 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.248974:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.248981:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.248991:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.249000:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.249034:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970384.249124:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+59:2403:x1875871082276480:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 271us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.249132:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00010000:00010000:2.0:1788970384.249149:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.249159:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970384.249232:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788970384.249238:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970384.249264:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.249313:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 59 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.249342:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 58 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.249351:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.249354:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970384.249357:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215b600, rc 0) 00000100:00100000:2.0:1788970384.249425:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11385:x1875871082276352:12345-192.168.203.15@tcp:101:bash.0 Request processed in 6545us (6930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.249441:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:3.0:1788970384.252161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.253689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082276736 00000100:00100000:0.0:1788970384.253734:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082276736 00000100:00100000:0.0:1788970384.253819:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:0.0:1788970384.253845:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+58:11385:x1875871082276736:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:0.0:1788970384.254203:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11385:x1875871082276736:12345-192.168.203.15@tcp:35:bash.0 Request processed in 361us (2053us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788970384.254212:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:3.0:1788970384.297295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.297431:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082276864 00000100:00100000:1.0:1788970384.297443:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082276864 00000100:00100000:1.0:1788970384.297510:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:1.0:1788970384.297522:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+59:11391:x1875871082276864:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970384.297553:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.297580:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f0e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8e0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.297669:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f0ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.297699:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f0ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.297739:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f0ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970384.297795:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788970384.297800:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970384.297823:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f0ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.297865:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f0e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e0 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.297889:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f0ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e0 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.297899:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970384.297903:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970384.297907:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:1.0:1788970384.298280:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11391:x1875871082276864:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 757us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.298289:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:3.0:1788970384.302295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.302521:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082276992 00000100:00100000:2.0:1788970384.302535:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082276992 00000100:00100000:2.0:1788970384.302613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:2.0:1788970384.302624:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11391:x1875871082276992:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970384.302984:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970384.303017:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8e7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303106:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303124:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303138:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303152:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303159:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303166:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.303266:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.304087:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.304098:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970384.304162:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788970384.304168:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970384.304192:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.304206:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.305646:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.305947:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.305956:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.305963:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970384.305969:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.305981:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306002:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970384.306005:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970384.306030:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306038:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f0f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306063:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306071:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306077:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306083:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970384.306086:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306093:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306101:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:2.0:1788970384.306104:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970384.306107:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306113:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f0ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306166:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f0f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e7 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306195:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e7 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.306203:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.306205:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970384.306208:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98800, rc 0) 00000100:00100000:2.0:1788970384.306328:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11391:x1875871082276992:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 3696us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.306339:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:3.0:1788970384.313144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970384.313258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.315343:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082277376 00000100:00100000:2.0:1788970384.315364:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082277376 00000100:00100000:2.0:1788970384.315497:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:2.0:1788970384.315510:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11391:x1875871082277376:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970384.315537:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788970384.315537:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082277120 00000100:00100000:0.0:1788970384.315545:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082277120 00010000:00010000:2.0:1788970384.315567:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f10d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8ee expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970384.315725:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1788970384.315734:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+63:2401:x1875871082277120:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970384.315805:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.315826:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 63 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.315836:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e7 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.315861:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.316143:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970384.316171:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970384.316177:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.316186:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.316194:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970384.316211:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e7 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.316240:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 62 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.316258:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 62 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.316285:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102274048:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970384.316520:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+62:2401:x1875871082277120:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 784us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970384.316531:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970384.316566:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970384.323793:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102274048:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970384.323832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00010000:00010000:2.0:1788970384.323837:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.323992:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082277504 00000100:00100000:1.0:1788970384.324002:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082277504 00010000:00010000:1.0:1788970384.324048:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 62 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.324093:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:1.0:1788970384.324104:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+62:2402:x1875871082277504:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970384.324144:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.324216:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 62 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.324232:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 62 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.324593:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f0dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d9 expref: 62 pid: 13652 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.324618:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.324624:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.324637:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.324647:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.325024:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970384.325308:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+61:2402:x1875871082277504:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1202us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.325327:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00010000:00010000:2.0:1788970384.327570:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.327591:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970384.327621:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788970384.330011:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f10d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 62 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.330075:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 61 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.330086:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.330089:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970384.330094:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98000, rc 0) 00000100:00100000:2.0:1788970384.330187:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11391:x1875871082277376:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 14678us (16926us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788970384.330197:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:3.0:1788970384.333550:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.334691:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082277760 00000100:00100000:1.0:1788970384.334709:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082277760 00000100:00100000:1.0:1788970384.334820:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970384.334835:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11391:x1875871082277760:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:1.0:1788970384.334978:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.335011:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f065 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8bd expref: 61 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.335033:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.335038:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970384.335110:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11391:x1875871082277760:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 279us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.335118:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1788970384.343158:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.343838:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082277888 00000100:00100000:0.0:1788970384.343852:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082277888 00000100:00100000:0.0:1788970384.343928:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:0.0:1788970384.343940:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11391:x1875871082277888:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:0.0:1788970384.344114:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.344143:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.344159:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970384.345437:0:10102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788970384.345603:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11391:x1875871082277888:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 1660us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970384.345615:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:3.0:1788970384.349635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.349749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082278016 00000100:00100000:2.0:1788970384.349764:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082278016 00000100:00100000:2.0:1788970384.349840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:2.0:1788970384.349855:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+60:11391:x1875871082278016:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970384.349882:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970384.349908:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8f5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.349984:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.349996:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.350019:0:6526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.350036:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.350076:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970384.350080:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970384.350085:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.350094:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99200, rc 0) 00000100:00100000:2.0:1788970384.350170:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11391:x1875871082278016:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 319us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.350179:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 123 00010000:00010000:1.0:1788970384.413533:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970384.669753:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970384.669782:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102274176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970384.669869:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970384.670061:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102274176 00000100:00100000:3.0:1788970384.670070:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102274176 00000100:00100000:3.0:1788970384.670126:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788970384.670152:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102274176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788970384.670188:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970384.670252:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102274176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970384.670259:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788970384.670306:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102274176:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788970384.671406:0:8687:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403938022021ns, next at 404938017765ns, rc = 0 00000100:00100000:3.0:1788970384.671442:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102274304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970384.671495:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970384.673201:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102274304 00000100:00100000:1.0:1788970384.673220:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102274304 00000100:00100000:1.0:1788970384.673300:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788970384.673312:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875871102274304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970384.673351:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970384.673483:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875871102274304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.673492:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788970384.673639:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102274304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788970384.673897:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788970384.797173:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970384.797186:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970384.797233:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788970384.797246:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970384.797488:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c71a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102274432:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970384.797894:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970384.802087:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c71a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102274432:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788970384.802615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.802907:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082278144 00000100:00100000:2.0:1788970384.802917:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082278144 00000100:00100000:2.0:1788970384.802977:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:2.0:1788970384.802988:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11392:x1875871082278144:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970384.803027:0:13652:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970384.803189:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11392:x1875871082278144:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 201us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.803198:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:3.0:1788970384.806770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.807046:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082278272 00000100:00100000:0.0:1788970384.807059:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082278272 00000100:00100000:0.0:1788970384.807140:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:0.0:1788970384.807152:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11392:x1875871082278272:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788970384.807271:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807292:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807310:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807337:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807345:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807374:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807437:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807448:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807454:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970384.807520:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788970384.807525:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970384.807541:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807553:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807560:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807567:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807574:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970384.807579:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807587:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807618:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:0.0:1788970384.807622:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970384.807629:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807636:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f130 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807654:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807661:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807667:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807673:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970384.807841:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807849:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807857:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8a7d8335f700) 00010000:00010000:0.0:1788970384.807860:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970384.807862:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807868:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f137 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807897:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807903:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807909:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807915:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970384.807918:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807923:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807931:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970384.807934:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970384.807937:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.807943:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f13e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970384.808043:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11392:x1875871082278272:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 890us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970384.808052:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:0.0:1788970384.815163:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.815376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082278528 00000100:00100000:1.0:1788970384.815417:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082278528 00000100:00100000:1.0:1788970384.815497:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:1.0:1788970384.815518:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+61:11392:x1875871082278528:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.815548:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.815576:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f145 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d8fc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.815900:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.815922:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.815938:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970384.815952:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788970384.816058:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816067:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816075:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816082:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970384.816088:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816096:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816110:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970384.816113:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788970384.816119:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816137:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f14c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816192:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f145 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8fc expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816203:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:1.0:1788970384.816206:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970384.816210:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f145 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8fc expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.816233:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655400, rc 0) 00000100:00100000:1.0:1788970384.816820:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+62:11392:x1875871082278528:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1308us (1668us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788970384.816830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:0.0:1788970384.828491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970384.828937:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082278656 00000100:00100000:3.0:1788970384.828951:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082278656 00000100:00100000:3.0:1788970384.829030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:3.0:1788970384.829042:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+62:11392:x1875871082278656:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788970384.829124:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970384.829411:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+62:11392:x1875871082278656:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 370us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970384.829420:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:0.0:1788970384.845481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.849409:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082278912 00000100:00100000:2.0:1788970384.849431:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082278912 00000100:00100000:2.0:1788970384.849578:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:2.0:1788970384.849591:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+62:11392:x1875871082278912:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970384.849621:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970384.849624:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970384.849661:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f0ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8e0 expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.849690:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970384.849696:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970384.849716:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f15a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d903 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970384.850235:0:10102:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788970384.850470:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f161 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.850487:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.850499:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.850559:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f15a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d903 expref: 64 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.850604:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d903 expref: 63 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.850613:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7e88bd6300) 00010000:00010000:2.0:1788970384.850616:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970384.850619:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98a00, rc 0) 00000100:00100000:2.0:1788970384.850713:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+63:11392:x1875871082278912:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1123us (5248us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788970384.850721:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:0.0:1788970384.856800:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.856895:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082279168 00000100:00100000:1.0:1788970384.856907:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082279168 00000100:00100000:1.0:1788970384.856970:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:1.0:1788970384.856979:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+63:11392:x1875871082279168:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.857059:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.857089:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f161 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d903 expref: 63 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857111:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7e88bd6300) 00010000:00010000:1.0:1788970384.857126:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970384.857154:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857193:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857206:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857224:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857232:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857238:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857296:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857304:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857312:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857327:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970384.857333:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857342:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857351:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:1.0:1788970384.857361:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970384.857366:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857372:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f16f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857426:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857434:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857440:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857445:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970384.857447:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857453:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857460:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc398e800 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970384.857463:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970384.857466:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.857472:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f176 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc398e800 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.857579:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+62:11392:x1875871082279168:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 599us (793us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970384.857594:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:3.0:1788970384.860551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.860690:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082279296 00000100:00100000:1.0:1788970384.860705:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082279296 00000100:00100000:1.0:1788970384.860778:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 130 00000100:00100000:1.0:1788970384.860792:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+62:11392:x1875871082279296:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.860820:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.860848:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f17d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d90a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.860894:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.860911:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.860925:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.861074:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f17d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.861100:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.861110:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:1.0:1788970384.861113:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970384.861118:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:1.0:1788970384.861205:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+63:11392:x1875871082279296:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 416us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.861221:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 130 00000100:00100000:0.0:1788970384.866567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.866685:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082279552 00000100:00100000:2.0:1788970384.866709:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082279552 00000100:00100000:2.0:1788970384.866798:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:2.0:1788970384.866810:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+63:11392:x1875871082279552:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970384.866923:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.866945:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.866958:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970384.867478:0:10102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788970384.867553:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c34d39fa reply state 0000000059afbcf2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.867570:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.867598:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:2.0:1788970384.867601:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788970384.867607:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970384.867751:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+65:11392:x1875871082279552:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 941us (1197us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788970384.867761:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:3.0:1788970384.871798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.871854:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082279680 00000100:00100000:0.0:1788970384.871867:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082279680 00000100:00100000:0.0:1788970384.871934:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:0.0:1788970384.871945:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+65:11392:x1875871082279680:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970384.871977:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970384.872005:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d911 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.872074:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.872091:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.872119:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:0.0:1788970384.872123:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970384.872127:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012600, rc 0) 00000100:00100000:0.0:1788970384.872201:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+66:11392:x1875871082279680:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 258us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970384.872210:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:3.0:1788970384.879983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.880718:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082279808 00000100:00100000:2.0:1788970384.880743:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082279808 00000100:00080000:1.0:1788970384.880830:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970384.880858:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:2.0:1788970384.880873:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082279808:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788970384.881191:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082279808:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 320us (1221us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788970384.881200:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:3.0:1788970384.885743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.886044:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082280064 00000100:00100000:0.0:1788970384.886059:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082280064 00000100:00100000:0.0:1788970384.886209:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:0.0:1788970384.886485:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+66:11392:x1875871082280064:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788970384.887827:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+67:11392:x1875871082280064:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1337us (2224us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788970384.887861:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:3.0:1788970384.892512:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.892633:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082280320 00000100:00100000:0.0:1788970384.892649:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082280320 00000100:00100000:0.0:1788970384.892743:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:0.0:1788970384.892756:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+67:11392:x1875871082280320:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788970384.892936:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+67:11392:x1875871082280320:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 182us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970384.892945:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:0.0:1788970384.896858:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.898857:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082280448 00000100:00100000:1.0:1788970384.898880:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082280448 00000100:00100000:1.0:1788970384.899026:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:1.0:1788970384.899039:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+67:11392:x1875871082280448:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.899066:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.899101:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f199 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d918 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.899190:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f1a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.899209:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.899225:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970384.899533:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970384.899562:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.899611:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f199 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d918 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.899633:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d918 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.899667:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:1.0:1788970384.899671:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788970384.899855:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:1.0:1788970384.899950:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+68:11392:x1875871082280448:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 913us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.899958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:2.0:1788970384.903298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970384.903415:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082280576 00000100:00100000:0.0:1788970384.903428:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082280576 00000100:00100000:1.0:1788970384.903574:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:1.0:1788970384.903590:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2403:x1875871082280576:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.903616:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970384.903646:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d91f expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970384.903680:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18590, blocks: 0x0 00010000:00010000:1.0:1788970384.903708:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1788970384.903714:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970384.903725:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.903821:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.903840:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655400, rc 0) 00000100:00100000:1.0:1788970384.903957:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2403:x1875871082280576:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 370us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.903990:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:2.0:1788970384.912711:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.912822:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082280832 00000100:00100000:1.0:1788970384.912839:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082280832 00000100:00100000:1.0:1788970384.912935:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:1.0:1788970384.912948:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+68:11392:x1875871082280832:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970384.913125:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+68:11392:x1875871082280832:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 180us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.913141:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:1.0:1788970384.919919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.920199:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082280960 00000100:00100000:2.0:1788970384.920221:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082280960 00000100:00100000:2.0:1788970384.920303:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:2.0:1788970384.920325:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+10:11392:x1875871082280960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970384.920349:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970384.920373:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d926 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.920576:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.920618:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970384.920623:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970384.920629:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.920670:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.920796:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 11 pid: 8440 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.920816:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875871102274560:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970384.921004:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970384.924477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.924606:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281088 00000100:00100000:1.0:1788970384.924618:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281088 00000100:00100000:2.0:1788970384.924658:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875871102274560:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970384.924673:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 12 pid: 8440 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.924715:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 12 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.924727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:1.0:1788970384.924738:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+12:2403:x1875871082281088:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970384.924747:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98c00, rc 0) 00010000:00010000:1.0:1788970384.924788:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.924820:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 12 pid: 8440 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.924834:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+12:11392:x1875871082280960:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 4520us (4929us total) trans 0 rc 0/0 00010000:00010000:1.0:1788970384.924837:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 12 pid: 8440 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.924848:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00010000:00010000:1.0:1788970384.924875:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d91f expref: 11 pid: 8440 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.924907:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970384.924911:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970384.924921:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.924933:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.924972:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.924989:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875871102274688:192.168.203.15@tcp:105: 00000100:00100000:1.0:1788970384.925053:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970384.929934:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875871102274688:192.168.203.15@tcp:105: 00010000:00010000:1.0:1788970384.929974:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970384.930161:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2403:x1875871082281088:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 5421us (5695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.930176:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:0.0:1788970384.931476:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970384.932059:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281216 00000100:00100000:3.0:1788970384.932074:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281216 00002000:00100000:3.0:1788970384.932148:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a7d83e86d00 x1875871082281216/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:160/0 lens 504/0 e 0 to 0 dl 1788970395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970384.932180:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e86d00 with x1875871082281216 ext(0->12) 00002000:00010000:3.0:1788970384.932194:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83e86d00 00000100:00100000:3.0:1788970384.932939:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970384.932956:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2403:x1875871082281216:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788970384.934229:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+12:2403:x1875871082281216:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 1267us (2748us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788970384.934263:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00002000:00100000:2.0:1788970384.934280:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a7d83e86d00 x1875871082281216/t4294967309(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:160/0 lens 504/448 e 0 to 0 dl 1788970395 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788970384.934291:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e86d00 with x1875871082281216 ext(0->12) 00002000:00010000:2.0:1788970384.934309:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83e86d00 00000100:00100000:0.0:1788970384.938110:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970384.938223:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281344 00000100:00100000:2.0:1788970384.938235:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281344 00000100:00100000:2.0:1788970384.938311:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:2.0:1788970384.938335:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+68:11392:x1875871082281344:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788970384.950632:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788970384.950673:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788970384.950717:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788970384.950747:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7e8133a180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788970384.950753:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7eae011d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7e8133a3c0 00000020:00080000:2.0:1788970384.950756:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7eae011c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7eaeebc000 00000004:00080000:2.0:1788970384.950790:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788970384.950830:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7d837bdd80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788970384.950833:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d8273cc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d837bd900 00000020:00080000:2.0:1788970384.950836:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d8273c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7e81343e00 00000020:00080000:2.0:1788970384.950866:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788970384.950943:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788970384.950967:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102274816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788970384.951057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970384.951137:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102274816 00000100:00100000:1.0:1788970384.951147:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102274816 00000100:00100000:1.0:1788970384.951218:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788970384.951229:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1875871102274816:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788970384.951238:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11392:x1875871082281344:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 12905us (13140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.951247:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00002000:00080000:1.0:1788970384.951288:0:10104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00080000:0.0:1788970384.951334:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788970384.951346:0:10104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa1858f, atime: 0x6aa1858f, ctime: 0x6aa1858f, blocks: 0x8 00010000:00010000:1.0:1788970384.951355:0:10104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.951376:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1788970384.951406:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970384.951414:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.951434:0:10104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.951445:0:10104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.951453:0:10104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.951471:0:10104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970384.951534:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970384.951541:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.951550:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970384.951555:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.951565:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.951584:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.951593:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c6f1b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970384.951614:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970384.951616:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970384.951617:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970384.951860:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3649:x1875871102274816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 632us (804us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788970384.951869:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788970384.951892:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102274944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788970384.951924:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788970384.951992:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e09e00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788970384.952003:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102274816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788970384.952022:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102274944 00000100:00100000:1.0:1788970384.952026:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102274944 00000100:00100000:1.0:1788970384.952064:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788970384.952071:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102274944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788970384.952087:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788970384.952105:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.952122:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 11 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.952131:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788970384.952135:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970384.952139:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.952173:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 11 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.952189:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 11 pid: 10104 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.952202:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875871102275072:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970384.952234:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952243:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952250:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952256:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970384.952261:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952273:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952287:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a7d823e8300) 00010000:00010000:3.0:1788970384.952291:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970384.952296:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952303:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6eeb3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952343:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952357:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952364:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952370:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970384.952375:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952436:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952447:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a7d823e8900) 00010000:00010000:3.0:1788970384.952449:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970384.952453:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952458:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6ef5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952478:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952485:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952492:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952498:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970384.952510:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952516:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952525:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:3.0:1788970384.952528:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970384.952530:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.952531:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653480 going to sleep for 11 seconds 00010000:00010000:3.0:1788970384.952537:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6efd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952553:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952558:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952635:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952640:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970384.952643:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952650:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952658:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7d823edb00) 00010000:00010000:3.0:1788970384.952660:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970384.952671:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952677:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6effc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952697:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952704:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952710:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952716:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970384.952719:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952725:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952733:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:3.0:1788970384.952734:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970384.952737:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952743:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f0ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952755:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952761:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952773:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952778:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970384.952781:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952788:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952795:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:3.0:1788970384.952798:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970384.952801:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970384.952808:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f18b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970384.956961:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970384.957055:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.959853:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281600 00000100:00100000:1.0:1788970384.959897:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281600 00010000:00010000:1.0:1788970384.960422:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 12 pid: 10104 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.960581:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:1.0:1788970384.960604:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+12:2402:x1875871082281600:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970384.960625:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.960634:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 12 pid: 10104 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.960654:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 12 pid: 10104 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.960815:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970384.960821:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970384.960827:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.960840:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.960873:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:0.0:1788970384.960904:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788970384.960926:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788970384.960973:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+12:2402:x1875871082281600:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 378us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970384.960993:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:2.0:1788970384.963376:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281472 00000100:00100000:2.0:1788970384.963415:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281472 00010000:00010000:1.0:1788970384.964258:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6ef69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d87e expref: 12 pid: 10104 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970384.964330:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875871102275072:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970384.964368:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970384.964424:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:2.0:1788970384.964437:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+11:2403:x1875871082281472:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.965229:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.965244:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.965258:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.965267:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970384.965301:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970384.965697:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970384.965706:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.965716:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970384.965721:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.965730:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.965767:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.965775:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068faea67/0xc3abfebe76c6f1bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970384.965801:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970384.965803:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970384.965804:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970384.973792:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875871102274944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21707us (21852us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788970384.973810:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1788970384.974465:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e84b40/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788970384.974487:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102274944:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788970384.988006:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788970384.988033:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1788970384.988346:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082281472:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 23907us (31396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970384.988358:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:3.0:1788970384.999216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970384.999604:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281856 00000100:00100000:1.0:1788970384.999615:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281856 00000100:00100000:1.0:1788970384.999854:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:1.0:1788970384.999881:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11392:x1875871082281856:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970384.999945:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970384.999978:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f1a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d918 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.000000:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:1.0:1788970385.000005:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970385.000037:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.000053:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.000064:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970385.000191:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035dbba1e reply state 000000006dd99bfd transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.000205:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.000211:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:1.0:1788970385.000514:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970385.000517:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970385.001437:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+17:11392:x1875871082281856:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 1554us (2224us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788970385.001448:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:0.0:1788970385.004540:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970385.004601:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082281984 00000100:00100000:2.0:1788970385.004613:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082281984 00000100:00100000:2.0:1788970385.004669:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1788970385.004681:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082281984:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788970385.004826:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788970385.004830:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788970384 00002000:00010000:2.0:1788970385.004832:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788970383 00002000:00010000:2.0:1788970385.004835:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788970384 -> 1788970384 00002000:00010000:2.0:1788970385.004837:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788970385.004896:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082281984:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 218us (364us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788970385.004904:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:0.0:1788970385.007582:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970385.007671:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082282240 00000100:00100000:2.0:1788970385.007683:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082282240 00000100:00100000:2.0:1788970385.007767:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:2.0:1788970385.007779:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+17:11392:x1875871082282240:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788970385.007845:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.007864:0:10102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.007874:0:10102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788970385.007902:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788970385.007909:0:10102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.007942:0:10102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 17 pid: 6526 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970385.007956:0:10102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102275200:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970385.008046:0:10102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970385.010768:0:10102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102275200:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970385.010798:0:10102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970385.013574:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970385.014032:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082282368 00000100:00100000:3.0:1788970385.014041:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082282368 00010000:00010000:3.0:1788970385.014081:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 18 pid: 6526 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970385.014131:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:3.0:1788970385.014155:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2403:x1875871082282368:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970385.014171:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970385.014178:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 18 pid: 6526 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.014192:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 18 pid: 6526 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.014226:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d90a expref: 18 pid: 6526 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.014243:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:3.0:1788970385.014249:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.014258:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.014266:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.014299:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970385.014371:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+17:2403:x1875871082282368:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 218us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970385.014378:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00010000:00010000:2.0:1788970385.014465:0:10102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014475:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014516:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014524:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014531:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014537:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970385.014542:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014652:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014664:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:2.0:1788970385.014667:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788970385.014891:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.014900:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970385.014959:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11392:x1875871082282240:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 7183us (7386us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788970385.014968:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:0.0:1788970385.019090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970385.019311:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082282496 00000100:00100000:1.0:1788970385.019331:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082282496 00000100:00100000:1.0:1788970385.019449:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:1.0:1788970385.019461:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082282496:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788970385.019505:0:10104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.019525:0:10104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.019534:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970385.019538:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970385.019543:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.019576:0:10104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.019589:0:10104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 7 pid: 8441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970385.019603:0:10104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10104:1875871102275328:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970385.019688:0:10104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970385.023494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970385.023915:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082282624 00000100:00100000:3.0:1788970385.023925:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082282624 00010000:00010000:3.0:1788970385.023965:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 8 pid: 8441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970385.024023:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:3.0:1788970385.024033:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082282624:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970385.024049:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970385.024071:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 8 pid: 8441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.024085:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 8 pid: 8441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.024109:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970385.024114:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970385.024120:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.024130:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.024154:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970385.024212:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082282624:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 180us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970385.024220:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00010000:00010000:1.0:1788970385.024443:0:10104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c6f1ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d926 expref: 7 pid: 8441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970385.024459:0:10104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10104:1875871102275328:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970385.024480:0:10104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024499:0:10104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024507:0:10104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024527:0:10104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024537:0:10104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024545:0:10104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024552:0:10104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970385.024557:0:10104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024566:0:10104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024578:0:10104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.024598:0:10104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f1d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970385.024646:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082282496:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 5188us (5563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970385.024655:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:0.0:1788970385.028969:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970385.029422:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082282880 00000100:00100000:3.0:1788970385.029435:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082282880 00000100:00100000:2.0:1788970385.029538:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:2.0:1788970385.029562:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+16:11392:x1875871082282880:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788970385.029645:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.029665:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.029678:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.029714:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.029744:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 16 pid: 6525 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970385.029760:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c72580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102275456:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970385.029840:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970385.034761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970385.034869:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082283008 00000100:00100000:1.0:1788970385.034879:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082283008 00010000:00010000:1.0:1788970385.034921:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 17 pid: 6525 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970385.035002:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:1.0:1788970385.035012:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+17:2403:x1875871082283008:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970385.035027:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970385.035035:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 17 pid: 6525 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.035048:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 17 pid: 6525 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.035069:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970385.035076:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.035087:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.035106:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.035114:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.035133:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970385.035189:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+17:2403:x1875871082283008:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 178us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970385.035197:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00010000:00010000:3.0:1788970385.039537:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f0c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8d2 expref: 16 pid: 6525 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970385.039589:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c72580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102275456:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970385.039617:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040021:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040031:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040259:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040275:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040521:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040562:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.040577:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 16 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970385.040592:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ce0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102275584:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970385.040731:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8215d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970385.048814:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970385.048937:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ce0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102275584:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970385.048964:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970385.049103:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082283136 00000100:00100000:3.0:1788970385.049110:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082283136 00010000:00010000:3.0:1788970385.049149:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 17 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970385.049187:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:3.0:1788970385.049197:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+17:2402:x1875871082283136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970385.049221:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970385.049228:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 17 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.049239:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 17 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.049261:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f192 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d911 expref: 17 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.049278:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:3.0:1788970385.049283:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.049293:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.049334:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.049368:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970385.049475:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+16:2402:x1875871082283136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 278us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970385.049482:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00010000:00010000:2.0:1788970385.049903:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.049911:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970385.050024:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788970385.050143:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788970385.050182:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788970385.050263:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c71680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102275712:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788970385.050330:0:13652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970385.050364:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970385.050540:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102275712 00000100:00100000:0.0:1788970385.050547:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102275712 00000100:00100000:0.0:1788970385.050594:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788970385.050603:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13652:x1875871102275712:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788970385.050708:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13652:x1875871102275712:12345-0@lo:1000:mdt00_004.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970385.050715:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788970385.051070:0:13652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788970385.051076:0:13652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788970385.051097:0:13652:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a7d83e84b40 x1875871102274944/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788970400 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970385.051107:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c71680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102275712:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788970385.051541:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788970385.051602:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c71680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102275840:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788970385.051654:0:13652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970385.051689:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970385.052234:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102275840 00000100:00100000:1.0:1788970385.052241:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102275840 00000100:00100000:1.0:1788970385.052283:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788970385.052292:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13652:x1875871102275840:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788970385.052467:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13652:x1875871102275840:12345-0@lo:1000:mdt00_004.0 Request processed in 175us (811us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788970385.052474:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788970385.052773:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c71680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102275840:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788970385.052812:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052822:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052829:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052836:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970385.052840:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052847:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052860:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:2.0:1788970385.052864:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970385.052868:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052874:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f1df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052896:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052901:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052918:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052923:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970385.052926:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052932:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052941:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970385.052944:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970385.052950:0:13652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052961:0:13652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.052971:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.053001:0:13652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970385.053015:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c71a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102275968:192.168.203.15@tcp:105: 00000100:00100000:2.0:1788970385.053081:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0e17480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970385.058983:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c71a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102275968:192.168.203.15@tcp:105: 00010000:00010000:0.0:1788970385.059016:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059046:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f122 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059079:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059093:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059105:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059115:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059121:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059128:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059134:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970385.059138:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059146:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059157:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970385.059160:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970385.059164:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059178:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f1e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059189:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059196:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059202:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059207:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970385.059210:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059229:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059239:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970385.059241:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970385.059244:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970385.059250:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f1d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970385.059629:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970385.059634:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970385.060151:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788970385.060162:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970385.060432:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11392:x1875871082282880:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 30879us (31467us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788970385.060448:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 139 00000020:00080000:0.0:1788970385.060466:0:13652:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788970385.070110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970385.070357:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082283264 00000100:00100000:2.0:1788970385.070371:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082283264 00000100:00100000:2.0:1788970385.070448:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:2.0:1788970385.070458:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11391:x1875871082283264:12345-192.168.203.15@tcp:49:lfs.0 00000100:00100000:2.0:1788970385.070594:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:11391:x1875871082283264:12345-192.168.203.15@tcp:49:lfs.0 Request processed in 136us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970385.070602:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:0.0:1788970385.080575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970385.080632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970385.080716:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082283520 00000100:00100000:1.0:1788970385.080718:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082283776 00000100:00100000:2.0:1788970385.080728:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082283520 00000100:00100000:1.0:1788970385.080728:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082283776 00000100:00100000:1.0:1788970385.080796:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:2.0:1788970385.080799:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:1.0:1788970385.080811:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11391:x1875871082283776:12345-192.168.203.15@tcp:58:lfs.0 00000100:00100000:2.0:1788970385.080813:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11392:x1875871082283520:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1788970385.081136:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788970385.081220:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:11391:x1875871082283776:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 411us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970385.081228:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 140 00000004:00080000:2.0:1788970385.083750:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788970385.083809:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788970385.083852:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.083869:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.083880:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.083887:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.083893:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.083917:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.083942:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970385.084061:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970385.084070:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.084152:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc0b518b0) 00000100:00100000:2.0:1788970385.084161:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:11392:x1875871082283520:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 3345us (3521us total) trans 4294967410 rc 0/0 00010000:00010000:3.0:1788970385.084162:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970385.084179:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00010000:00010000:3.0:1788970385.084180:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788970385.084187:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788970385.084196:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:3.0:1788970385.084201:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788970385.084206:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.084211:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f1ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970385.084225:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970385.084227:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970385.084229:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970385.124746:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970385.124824:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082283904 00000100:00100000:2.0:1788970385.124835:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082283904 00000100:00100000:2.0:1788970385.125009:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:2.0:1788970385.125021:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+21:11394:x1875871082283904:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970385.125046:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970385.125066:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f1f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d92d expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125128:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125144:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125157:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125173:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125181:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125202:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125673:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125689:0:10102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 22 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125698:0:10102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125736:0:10102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 22 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.125753:0:10102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 22 pid: 13652 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970385.125769:0:10102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102276096:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970385.126632:0:10102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970385.135936:0:10102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102276096:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970385.135968:0:10102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970385.136838:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970385.136947:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284160 00000100:00100000:2.0:1788970385.136958:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284160 00000100:00100000:2.0:1788970385.137030:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:2.0:1788970385.137041:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:6172:x1875871082284160:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788970385.137289:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:6172:x1875871082284160:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 249us (462us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788970385.137297:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1788970385.148460:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970385.148572:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284288 00000100:00100000:1.0:1788970385.148586:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284288 00010000:00010000:1.0:1788970385.148671:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 24 pid: 13652 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970385.148722:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:1.0:1788970385.148734:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+24:2402:x1875871082284288:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970385.148751:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970385.148760:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 24 pid: 13652 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.148775:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 24 pid: 13652 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.148807:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f114 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8ee expref: 24 pid: 13652 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.148832:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970385.148840:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.148852:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.148861:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970385.148904:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970385.148972:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+23:2402:x1875871082284288:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 239us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970385.148980:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00010000:00010000:2.0:1788970385.149674:0:10102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149687:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970385.149766:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788970385.149771:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970385.149800:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149816:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149827:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149834:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149842:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149848:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970385.149853:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149861:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149885:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:2.0:1788970385.149888:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970385.149893:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149911:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f1fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149925:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149932:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149938:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149943:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970385.149946:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149951:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149958:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a7e88bd6600) 00010000:00010000:2.0:1788970385.149960:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970385.149963:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.149968:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f202 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.150026:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f1f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d92d expref: 23 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.150041:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d92d expref: 22 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970385.150048:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970385.150050:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970385.150052:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99400, rc 0) 00000100:00100000:2.0:1788970385.150115:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11394:x1875871082283904:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 25096us (25379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970385.150124:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00010000:00010000:0.0:1788970385.445089:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970385.603893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970385.605089:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970385.605169:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970385.606101:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284800 00000100:00100000:3.0:1788970385.606125:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284800 00000100:00100000:3.0:1788970385.606215:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:3.0:1788970385.606229:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082284800:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970385.606353:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082284800:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 127us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970385.606362:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:0.0:1788970385.608421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970385.608534:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970385.608566:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00080000:1.0:1788970385.610299:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970385.613492:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284672 00000100:00100000:1.0:1788970385.613515:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284672 00000100:00100000:1.0:1788970385.613809:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1788970385.613825:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082284672:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970385.614407:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082284672:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 559us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970385.614418:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1788970385.614460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284416 00000100:00100000:1.0:1788970385.614466:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284416 00000100:00100000:1.0:1788970385.614502:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 377 00000100:00100000:1.0:1788970385.614510:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082284416:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970385.614538:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082284416:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (6131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970385.614544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 377 00000100:00100000:2.0:1788970385.616350:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284544 00000100:00100000:2.0:1788970385.616368:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284544 00000100:00080000:1.0:1788970385.616495:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970385.616601:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082285056 00000100:00100000:2.0:1788970385.616607:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082285056 00000100:00080000:2.0:1788970385.616649:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970385.616700:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 279 00000100:00100000:2.0:1788970385.616713:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082284544:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970385.616795:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082284544:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 84us (12916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970385.616802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 279 00000100:00100000:2.0:1788970385.616821:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 280 00000100:00100000:2.0:1788970385.616827:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082285056:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970385.616849:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082285056:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (11680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970385.616868:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 280 00000100:00100000:2.0:1788970385.620735:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082284928 00000100:00100000:2.0:1788970385.620750:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082284928 00000100:00080000:0.0:1788970385.620837:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970385.620847:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 281 00000100:00100000:2.0:1788970385.620861:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082284928:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970385.620937:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8276d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082284928:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 82us (12371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970385.620944:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 281 00000100:00100000:0.0:1788970385.693636:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970385.693661:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102276224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970385.693729:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970385.693858:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102276224 00000100:00100000:3.0:1788970385.693866:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102276224 00000100:00100000:3.0:1788970385.693920:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788970385.693928:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102276224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970385.693960:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788970385.694004:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102276224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970385.694011:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788970385.694083:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102276224:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788970386.022191:0:14269:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970386.022201:0:14269:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970386.022236:0:14269:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788970386.022245:0:14269:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788970386.077643:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970386.077651:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970386.077674:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788970386.077681:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970386.077825:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102276352:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970386.077938:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e83ff4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970386.084536:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102276352:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970386.095486:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970386.095646:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082285184 00000100:00100000:1.0:1788970386.095657:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082285184 00000100:00100000:1.0:1788970386.095726:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:1.0:1788970386.095738:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11406:x1875871082285184:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970386.095777:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970386.095903:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11406:x1875871082285184:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 167us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970386.095910:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:0.0:1788970386.103576:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970386.103646:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082285440 00000100:00100000:1.0:1788970386.103658:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082285440 00000100:00100000:1.0:1788970386.103786:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:1.0:1788970386.103798:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:11406:x1875871082285440:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970386.103823:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970386.103847:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f210 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d934 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970386.103975:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970386.103993:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970386.104009:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970386.104022:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788970386.104139:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f210 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d934 expref: 25 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970386.104158:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d934 expref: 24 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970386.104167:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970386.104171:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970386.104175:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655400, rc 0) 00000100:00100000:1.0:1788970386.104264:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+24:11406:x1875871082285440:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 469us (701us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788970386.104271:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:3.0:1788970386.111418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970386.111462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970386.111492:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082285824 00000100:00100000:3.0:1788970386.111501:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082285824 00000100:00100000:3.0:1788970386.111562:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1788970386.111572:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:2403:x1875871082285824:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970386.111586:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970386.111611:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d934 expref: 24 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970386.111632:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:3.0:1788970386.111637:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970386.111713:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:2403:x1875871082285824:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 142us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970386.111722:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:0.0:1788970386.112003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082285696 00000100:00100000:0.0:1788970386.112008:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082285696 00000100:00100000:0.0:1788970386.112046:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 144 00000100:00100000:0.0:1788970386.112053:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:11406:x1875871082285696:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788970386.112132:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112160:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112172:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112350:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112359:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112366:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112372:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970386.112376:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112409:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112419:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970386.112422:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970386.112426:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970386.112432:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f225 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970386.112529:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:11406:x1875871082285696:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 475us (1151us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788970386.112544:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 144 00000040:00080000:2.0:1788970386.112821:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970386.112827:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970386.115053:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788970386.115512:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970386.117444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970386.117505:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286080 00000100:00100000:3.0:1788970386.117519:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286080 00000100:00100000:3.0:1788970386.117975:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:3.0:1788970386.117991:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:11406:x1875871082286080:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788970386.119040:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+25:11406:x1875871082286080:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1044us (1601us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788970386.119989:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00010000:00010000:3.0:1788970386.460674:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970387.232249:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970387.232273:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102276480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970387.232349:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970387.234898:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102276480 00000100:00100000:0.0:1788970387.234913:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102276480 00000100:00100000:0.0:1788970387.234977:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788970387.234987:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102276480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970387.235034:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970387.235120:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102276480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970387.235128:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788970387.235406:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102276480:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970387.489734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970387.907460:0:14320:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970387.907471:0:14320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970387.907504:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788970387.907511:0:14320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788970388.161677:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970388.162547:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286336 00000100:00100000:1.0:1788970388.162570:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286336 00000100:00100000:1.0:1788970388.162644:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:1.0:1788970388.162656:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+25:11427:x1875871082286336:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970388.162681:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970388.162701:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f22c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d93b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970388.162803:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f233 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970388.162818:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970388.162831:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970388.162840:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788970388.162936:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f22c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d93b expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970388.162955:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f233 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d93b expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970388.162963:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:1.0:1788970388.162965:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788970388.162969:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655000, rc 0) 00000100:00100000:1.0:1788970388.163027:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+27:11427:x1875871082286336:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 374us (1359us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788970388.163034:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00080000:0.0:1788970388.163100:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970388.174252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970388.174357:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286464 00000100:00100000:2.0:1788970388.174368:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286464 00000100:00100000:2.0:1788970388.174464:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:2.0:1788970388.174474:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+27:11427:x1875871082286464:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1788970388.174543:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174561:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174573:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174742:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174750:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174757:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174763:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970388.174768:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174792:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174806:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:2.0:1788970388.174809:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970388.174815:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.174822:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98000/0xc3abfebe76c6f241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970388.174896:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+27:11427:x1875871082286464:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 423us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970388.174905:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:0.0:1788970388.252841:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102276736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970388.252923:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970388.252993:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970388.252999:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102276608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970388.253024:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970388.253057:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102276736 00000100:00100000:0.0:1788970388.253064:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102276736 00000100:00100000:0.0:1788970388.253110:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102276608 00000100:00100000:0.0:1788970388.253113:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102276608 00000100:00100000:0.0:1788970388.253132:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788970388.253141:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d826f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102276736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970388.253167:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970388.253208:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d826f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102276736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970388.253215:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788970388.253247:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788970388.253253:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102276608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970388.253264:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970388.253288:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102276608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970388.253306:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788970388.253326:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970388.253359:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102276608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970388.253368:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788970388.253373:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788970388.253411:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7e91e403c0, transno 4294967302 00000004:00080000:0.0:1788970388.253421:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788970388.253433:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e09e00, transno 4294967305 00000100:00100000:0.0:1788970388.253441:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102276736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970388.253871:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102276864:0@lo:400:kworker.0 00000100:00100000:2.0:1788970388.253907:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102277120:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.253966:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970388.253974:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970388.254068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102276864 00000100:00100000:1.0:1788970388.254078:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102276864 00000100:00100000:0.0:1788970388.254095:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102276992:0@lo:400:kworker.0 00000100:00100000:1.0:1788970388.254148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788970388.254161:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102276864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970388.255466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102277632:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.259100:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.261439:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970388.261530:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102277888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.261597:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970388.261671:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277120 00000100:00100000:3.0:1788970388.261683:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277120 00000100:00100000:3.0:1788970388.261871:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277376 00000100:00100000:3.0:1788970388.261876:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277376 00000100:00100000:3.0:1788970388.261897:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788970388.261906:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102277120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.261974:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102277120:12345-0@lo:400:kworker.0 Request processed in 69us (8003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970388.262000:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788970388.262021:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788970388.262028:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102277376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.262065:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102277376:12345-0@lo:400:kworker.0 Request processed in 38us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970388.262071:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788970388.262092:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277888 00000100:00100000:3.0:1788970388.262095:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277888 00000100:00100000:3.0:1788970388.262146:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788970388.262152:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102277888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.262184:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102277888:12345-0@lo:400:kworker.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970388.262201:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788970388.262270:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.262304:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102277888:0@lo:400:kworker.0 00000100:00080000:3.0:1788970388.262508:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970388.262526:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102277248:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.262564:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970388.262590:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102277760:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.262613:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970388.262649:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277248 00000100:00100000:3.0:1788970388.262653:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277248 00000100:00100000:3.0:1788970388.262691:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788970388.262699:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102277248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.263007:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102277248:12345-0@lo:400:kworker.0 Request processed in 309us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970388.263014:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788970388.263034:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277760 00000100:00100000:3.0:1788970388.263037:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277760 00000100:00100000:3.0:1788970388.263068:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788970388.263074:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102277760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.263104:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102277760:12345-0@lo:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970388.263110:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788970388.263122:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970388.263142:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102277248:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.263151:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102277760:0@lo:400:kworker.0 00000100:00100000:1.0:1788970388.266149:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102276864:12345-0@lo:400:kworker.0 Request processed in 11978us (12173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970388.266168:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788970388.266845:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970388.267081:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102277504:0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.267127:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970388.267162:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102276992 00000100:00100000:0.0:1788970388.267170:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102276992 00000100:00100000:0.0:1788970388.267216:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277504 00000100:00100000:0.0:1788970388.267219:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277504 00000100:00100000:0.0:1788970388.267250:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788970388.267260:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102276992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.267323:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102276992:12345-0@lo:400:kworker.0 Request processed in 64us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970388.267348:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788970388.267376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788970388.267415:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102277504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.267449:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102277504:12345-0@lo:400:kworker.0 Request processed in 68us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970388.267455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1788970388.267474:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970388.267507:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102277504:0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.267514:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102278016:0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.267536:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970388.267588:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102276992:0@lo:400:kworker.0 00000100:00100000:1.0:1788970388.267604:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278016 00000100:00100000:1.0:1788970388.267616:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278016 00000100:00080000:0.0:1788970388.267690:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970388.267727:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788970388.267736:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102278016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.267770:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102278016:12345-0@lo:400:kworker.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970388.268800:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788970388.269001:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102278016:0@lo:400:kworker.0 00000100:00100000:2.0:1788970388.269037:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970388.269085:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102278144:0@lo:400:kworker.0 00000100:00100000:1.0:1788970388.269092:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102277632 00000100:00100000:1.0:1788970388.269104:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102277632 00000100:00100000:2.0:1788970388.269122:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970388.269177:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278144 00000100:00100000:1.0:1788970388.269182:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278144 00000100:00100000:1.0:1788970388.269223:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788970388.269235:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102277632:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788970388.269257:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970388.269302:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788970388.269316:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102278144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970388.269355:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102277632:12345-0@lo:400:kworker.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970388.269367:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788970388.269430:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102278144:12345-0@lo:400:kworker.0 Request processed in 117us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970388.269456:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:2.0:1788970388.269781:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83590f00 x1875871102278144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970388.269794:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102278144:0@lo:400:kworker.0 00000100:00100000:2.0:1788970388.269829:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102277120:0@lo:400:kworker.0 00010000:00080000:2.0:1788970388.269841:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8366f0c0 x1875871102277632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970388.269859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102277632:0@lo:400:kworker.0 00000100:00100000:3.0:1788970388.272972:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102276864:0@lo:400:kworker.0 00000100:00100000:0.0:1788970388.279067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970388.279190:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286592 00000100:00100000:2.0:1788970388.279200:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286592 00000100:00100000:2.0:1788970388.279334:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:2.0:1788970388.279346:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e91e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2401:x1875871082286592:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:2.0:1788970388.279364:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970388.279435:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c6f248 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d942 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970388.279462:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa18590, atime: 0x6aa1858f, ctime: 0x6aa18590, blocks: 0x8 00010000:00010000:2.0:1788970388.279485:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1788970388.279490:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970388.279498:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c6f248 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d942 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.279519:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c6f248 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d942 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970388.279533:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98000, rc 0) 00000100:00100000:2.0:1788970388.279584:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e91e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2401:x1875871082286592:12345-192.168.203.15@tcp:101:cat.0 Request processed in 241us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970388.279591:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00080000:0.0:1788970388.285169:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970388.288323:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970388.288423:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286720 00000100:00100000:0.0:1788970388.288433:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286720 00002000:00100000:0.0:1788970388.288486:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8a7d83e4c780 x1875871082286720/t0(0) o3->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:164/0 lens 488/0 e 0 to 0 dl 1788970399 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970388.288498:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e4c780 with x1875871082286720 ext(0->4095) 00002000:00010000:0.0:1788970388.288504:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83e4c780 00000100:00100000:0.0:1788970388.288575:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:0.0:1788970388.288587:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082286720:12345-192.168.203.15@tcp:3:cat.0 00000100:00100000:0.0:1788970388.288797:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082286720:12345-192.168.203.15@tcp:3:cat.0 Request processed in 212us (485us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788970388.288806:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00002000:00100000:0.0:1788970388.288813:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8a7d83e4c780 x1875871082286720/t0(0) o3->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:164/0 lens 488/4536 e 0 to 0 dl 1788970399 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788970388.288823:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e4c780 with x1875871082286720 ext(0->4095) 00002000:00010000:0.0:1788970388.288826:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83e4c780 00010000:00010000:3.0:1788970388.508861:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970389.532650:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788970389.791843:0:8687:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409058459527ns, next at 410058457207ns, rc = 0 00000100:00100000:1.0:1788970389.791863:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970389.791882:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102278400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970389.791941:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970389.791996:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278400 00000100:00100000:1.0:1788970389.792004:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278400 00000100:00100000:1.0:1788970389.792039:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788970389.792046:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102278400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970389.792072:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788970389.792116:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102278400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970389.792123:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788970389.792164:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83590f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102278400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970389.794626:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102278272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970389.794692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970389.794866:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278272 00000100:00100000:1.0:1788970389.794875:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278272 00000100:00100000:1.0:1788970389.794989:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788970389.794999:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102278272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970389.795022:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788970389.795070:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102278272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970389.795077:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788970389.795126:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102278272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788970390.556623:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970390.724458:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970390.724500:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970390.724535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970390.724555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970390.724581:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970390.724608:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287104 00000100:00100000:1.0:1788970390.724617:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287104 00000100:00100000:1.0:1788970390.724669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287616 00000100:00100000:1.0:1788970390.724672:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287616 00000100:00100000:1.0:1788970390.724696:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286976 00000100:00100000:1.0:1788970390.724698:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286976 00000100:00100000:1.0:1788970390.724716:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00100000:1.0:1788970390.724725:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d833583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082287104:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970390.724790:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d833583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082287104:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970390.724806:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 288 00000100:00100000:1.0:1788970390.724823:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 289 00000100:00100000:1.0:1788970390.724830:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082287616:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970390.724855:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082287616:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970390.724860:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 289 00000100:00100000:1.0:1788970390.724871:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:1.0:1788970390.724877:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83590f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+27:2400:x1875871082286976:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970390.724898:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83590f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+27:2400:x1875871082286976:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970390.724904:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 290 00000100:00100000:3.0:1788970390.725063:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287360 00000100:00100000:3.0:1788970390.725067:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287360 00000100:00100000:3.0:1788970390.725108:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:3.0:1788970390.725116:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082287360:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970390.725144:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2400:x1875871082287360:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 29us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970390.725151:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:0.0:1788970390.725585:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082286848 00000100:00100000:0.0:1788970390.725591:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082286848 00000100:00100000:0.0:1788970390.725631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 379 00000100:00100000:0.0:1788970390.725640:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082286848:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970390.725676:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2400:x1875871082286848:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 37us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970390.725694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 379 00000100:00080000:0.0:1788970390.725722:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970390.725726:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970390.725728:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970390.726713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970390.726756:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970390.726833:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287232 00000100:00100000:3.0:1788970390.726850:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287232 00000100:00100000:3.0:1788970390.726902:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:3.0:1788970390.726911:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2400:x1875871082287232:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970390.726956:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2400:x1875871082287232:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970390.726963:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:0.0:1788970390.727100:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287488 00000100:00100000:0.0:1788970390.727106:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287488 00000100:00100000:0.0:1788970390.727140:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 291 00000100:00100000:0.0:1788970390.727147:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082287488:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970390.727190:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2400:x1875871082287488:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 42us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970390.727196:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 291 00000100:00080000:1.0:1788970390.727303:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970390.727308:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970390.819052:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970390.819078:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102278528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970390.819152:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970390.819834:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278528 00000100:00100000:2.0:1788970390.819846:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278528 00000100:00100000:2.0:1788970390.819901:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788970390.819912:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102278528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970390.819947:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788970390.820014:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102278528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970390.820021:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788970390.820066:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102278528:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788970390.824122:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788970390.824138:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:2.0:1788970390.827370:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1788970390.827894:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102278656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788970390.827962:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1788970390.828412:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788970390.828440:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7eb5954540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788970390.828445:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7eae011700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7eb5954e40 00000020:00080000:2.0:1788970390.828448:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7eae011200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7e81343e00 00000020:00080000:2.0:1788970390.828474:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788970390.828493:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788970390.828562:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788970390.828859:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278656 00000100:00100000:1.0:1788970390.828868:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278656 00000100:00100000:1.0:1788970390.828921:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970390.828929:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102278656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788970390.829409:0:10104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788970390.829413:0:10104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788970384 -> 1788970384 00002000:00010000:1.0:1788970390.829415:0:10104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788970383 -> 1788970383 00002000:00010000:1.0:1788970390.829430:0:10104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788970384 -> 1788970384 00002000:00010000:1.0:1788970390.829432:0:10104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788970390.829499:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102278656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 570us (1537us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788970390.829508:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970390.829557:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788970390.829564:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e84b40, transno 4294967310 00000004:00080000:1.0:1788970390.829574:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788970390.829601:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a7d835c5680 x1875871102278656/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788970406 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788970390.829612:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d835c5680/2, rc 0, transno 4294967313 00000100:00100000:1.0:1788970390.829617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102278656:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788970390.829788:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788970390.834356:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970390.834374:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970390.834766:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970390.834774:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970390.834779:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970390.834802:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970390.834823:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a7eb55b5400) 00010000:00010000:0.0:1788970390.834827:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970390.834832:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970390.834839:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f1c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970391.260708:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970391.260717:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970391.260738:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788970391.260745:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788970391.580624:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970391.646986:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970392.348777:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102278784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970392.348856:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970392.349118:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278784 00000100:00100000:2.0:1788970392.349126:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278784 00000100:00100000:2.0:1788970392.349191:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788970392.349201:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102278784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970392.349234:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970392.349301:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102278784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970392.349309:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788970392.349370:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaef2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102278784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970392.607992:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970393.373716:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102278912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970393.376637:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970393.376709:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102279424:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.376735:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970393.376764:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102279936:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.376787:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.376803:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279424 00000100:00100000:0.0:1788970393.376804:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102280448:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.376810:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279424 00000100:00100000:0.0:1788970393.376821:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970393.376838:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788970393.376843:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102279040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970393.376855:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788970393.376863:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.376864:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102279424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.376889:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102279552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.376907:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.376915:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102279424:12345-0@lo:400:kworker.0 Request processed in 52us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.376920:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102280064:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.376922:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788970393.376938:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.376946:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279936 00000100:00100000:3.0:1788970393.376949:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279936 00000100:00100000:0.0:1788970393.376953:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102280576:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.376970:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.376978:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280448 00000100:00100000:3.0:1788970393.376981:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280448 00000100:00100000:3.0:1788970393.376997:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279552 00000100:00100000:3.0:1788970393.376999:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279552 00000100:00100000:0.0:1788970393.376999:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102279424:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377010:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788970393.377015:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102279936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102279168:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377048:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102279936:12345-0@lo:400:kworker.0 Request processed in 33us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.377054:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788970393.377057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.377066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788970393.377072:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102280448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102279680:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.377103:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102280448:12345-0@lo:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.377109:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788970393.377114:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102280192:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377120:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788970393.377125:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102279552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377131:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970393.377147:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102280704:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377148:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102279552:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.377153:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788970393.377169:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279680 00000100:00100000:3.0:1788970393.377173:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279680 00000100:00100000:0.0:1788970393.377179:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.377193:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788970393.377198:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102279680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377198:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788970393.377204:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102279296:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377224:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102279680:12345-0@lo:400:kworker.0 Request processed in 27us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.377224:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.377230:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788970393.377237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8366fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102279808:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377265:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970393.377266:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970393.377276:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279296 00000100:00100000:0.0:1788970393.377277:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377278:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279296 00000100:00100000:3.0:1788970393.377293:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279808 00000100:00100000:3.0:1788970393.377295:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279808 00000100:00100000:0.0:1788970393.377296:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970393.377310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280320 00000100:00100000:0.0:1788970393.377311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102279680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377312:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280320 00000100:00100000:3.0:1788970393.377323:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788970393.377328:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102279296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377331:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102278912 00000100:00100000:0.0:1788970393.377339:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102278912 00000100:00100000:0.0:1788970393.377364:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279040 00000100:00100000:0.0:1788970393.377367:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279040 00000100:00100000:0.0:1788970393.377402:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788970393.377408:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102278912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970393.377429:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970393.377460:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102278912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.377465:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788970393.377478:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788970393.377484:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102279040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970393.377494:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970393.377515:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102279040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.377521:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788970393.377675:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102279296:12345-0@lo:400:kworker.0 Request processed in 32us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.377681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788970393.377701:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788970393.377707:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102279808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377738:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788970393.377745:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102279808:12345-0@lo:400:kworker.0 Request processed in 38us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.377746:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102280320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788970393.377768:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280064 00000100:00100000:3.0:1788970393.377771:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280064 00000100:00100000:0.0:1788970393.377774:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102280320:12345-0@lo:400:kworker.0 Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.377779:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788970393.377794:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280576 00000100:00100000:3.0:1788970393.377797:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280576 00000100:00100000:0.0:1788970393.377804:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280192 00000100:00100000:3.0:1788970393.377805:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280704 00000100:00100000:3.0:1788970393.377807:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280704 00000100:00100000:0.0:1788970393.377807:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280192 00000100:00100000:3.0:1788970393.377816:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788970393.377821:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.377828:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788970393.377833:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102280576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.377849:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102280064:12345-0@lo:400:kworker.0 Request processed in 28us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.377856:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788970393.377856:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102280576:12345-0@lo:400:kworker.0 Request processed in 23us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.377861:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788970393.380485:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788970393.380518:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102280704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.380607:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102280704:12345-0@lo:400:kworker.0 Request processed in 110us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.380613:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788970393.380642:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788970393.380650:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83de3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102280192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.380677:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83de3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102280192:12345-0@lo:400:kworker.0 Request processed in 29us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.380683:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788970393.380737:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102279296:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.380762:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102279808:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.380774:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.380786:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102280192:0@lo:400:kworker.0 00000100:00100000:3.0:1788970393.380796:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102280704:0@lo:400:kworker.0 00000100:00080000:3.0:1788970393.380835:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970393.380840:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970393.380843:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970393.383721:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102279168 00000100:00100000:0.0:1788970393.383734:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102279168 00000100:00100000:0.0:1788970393.383790:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788970393.383799:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102279168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.383881:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102279168:12345-0@lo:400:kworker.0 Request processed in 84us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970393.383888:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788970393.383960:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102279168:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.384001:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102279040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970393.384013:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102279552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.384025:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102280064:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.384034:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102280576:0@lo:400:kworker.0 00010000:00080000:0.0:1788970393.384047:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83e083c0 x1875871102279936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970393.384057:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102279936:0@lo:400:kworker.0 00010000:00080000:0.0:1788970393.384068:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83e09e00 x1875871102280448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970393.384076:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102280448:0@lo:400:kworker.0 00000100:00100000:0.0:1788970393.384090:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102278912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788970393.629269:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970393.757462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970393.757713:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287744 00000100:00100000:3.0:1788970393.757723:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287744 00000100:00100000:3.0:1788970393.757804:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:3.0:1788970393.757815:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11080:x1875871082287744:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788970393.757921:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11080:x1875871082287744:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 108us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970393.757929:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00080000:0.0:1788970393.757998:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970393.760598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970393.760748:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082287872 00000100:00100000:2.0:1788970393.760759:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082287872 00000100:00100000:2.0:1788970393.760831:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 148 00000100:00100000:2.0:1788970393.760842:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:11080:x1875871082287872:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788970393.760943:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:11080:x1875871082287872:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970393.760950:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 148 00000100:00080000:0.0:1788970393.761442:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970393.770968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970393.771079:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288128 00000100:00100000:3.0:1788970393.771089:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288128 00000100:00100000:3.0:1788970393.771147:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:3.0:1788970393.771164:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+13:11080:x1875871082288128:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788970393.771454:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+14:11080:x1875871082288128:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 290us (495us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788970393.771460:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00010000:00010000:3.0:1788970394.660762:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970394.908646:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102280832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970394.908717:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970394.908884:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102280960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970394.908918:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970394.908974:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280832 00000100:00100000:1.0:1788970394.908983:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280832 00000100:00100000:0.0:1788970394.909042:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102280960 00000100:00100000:1.0:1788970394.909046:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788970394.909053:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102280960 00000100:00100000:1.0:1788970394.909060:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf522580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102280832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970394.909080:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788970394.909088:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102280960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970394.909092:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00002000:00000024:0.0:1788970394.909102:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788970394.909212:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaeef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102280832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970394.909264:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102280960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970394.918893:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102280960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9787us (9955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970394.918908:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788970394.925379:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf522580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102280832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16310us (16649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970394.925421:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:1.0:1788970395.676814:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970395.759898:0:14517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:13:14 (1788970394) 00000100:00100000:1.0:1788970395.844363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970395.846335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288256 00000100:00100000:3.0:1788970395.846350:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288256 00000100:00100000:2.0:1788970395.846655:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 381 00000100:00100000:2.0:1788970395.846670:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2403:x1875871082288256:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970395.846753:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2403:x1875871082288256:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 88us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970395.846762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 381 00000100:00100000:1.0:1788970395.850421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970395.850453:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970395.850475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970395.850498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970395.850519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970395.850541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970395.850574:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288512 00000100:00100000:1.0:1788970395.850583:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288512 00000100:00100000:1.0:1788970395.850637:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082289024 00000100:00100000:1.0:1788970395.850640:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082289024 00000100:00100000:1.0:1788970395.850654:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288384 00000100:00100000:1.0:1788970395.850657:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288384 00000100:00100000:1.0:1788970395.850669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288896 00000100:00100000:1.0:1788970395.850672:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288896 00000100:00100000:1.0:1788970395.850690:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:1.0:1788970395.850699:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082288512:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970395.850768:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082288512:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.850776:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 298 00000100:00100000:1.0:1788970395.850793:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:1.0:1788970395.850800:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082289024:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970395.850826:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082289024:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.850832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 299 00000100:00100000:1.0:1788970395.850845:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 300 00000100:00100000:1.0:1788970395.850851:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+14:2403:x1875871082288384:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970395.850893:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+14:2403:x1875871082288384:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.850900:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 300 00000100:00100000:1.0:1788970395.850914:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 301 00000100:00100000:1.0:1788970395.850920:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082288896:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970395.850943:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082288896:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.850948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 301 00000100:00100000:1.0:1788970395.850972:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288768 00000100:00100000:1.0:1788970395.850976:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288768 00000100:00100000:1.0:1788970395.851003:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082288640 00000100:00100000:1.0:1788970395.851005:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082288640 00000100:00100000:1.0:1788970395.851027:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:1.0:1788970395.851034:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082288768:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970395.851062:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2403:x1875871082288768:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.851068:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:1.0:1788970395.851080:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:1.0:1788970395.851087:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082288640:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970395.851111:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082288640:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.851117:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00080000:2.0:1788970395.852811:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970395.852818:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970395.852821:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970395.852824:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970395.932568:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102281088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970395.932658:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970395.932743:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281088 00000100:00100000:1.0:1788970395.932751:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281088 00000100:00100000:1.0:1788970395.932796:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788970395.932806:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102281088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970395.932844:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788970395.932906:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102281088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970395.932914:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788970395.933317:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102281088:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788970396.446175:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1788970396.451610:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788970396.451628:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788970396.451672:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788970396.451685:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788970396.700843:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970396.939006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970396.939114:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082289280 00000100:00100000:1.0:1788970396.939125:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082289280 00000100:00100000:1.0:1788970396.939321:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:1.0:1788970396.939333:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+13:12145:x1875871082289280:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970396.939353:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970396.939374:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f24f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d949 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939473:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939487:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939500:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939515:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939549:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939572:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939680:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f264 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939690:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f264 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939697:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f264 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970396.939707:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788970396.939795:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939803:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939811:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939817:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970396.939821:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939829:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939852:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7d83360700) 00010000:00010000:1.0:1788970396.939855:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970396.939860:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939866:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f256 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939880:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939885:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939890:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939895:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970396.939897:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939903:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939919:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a7eb55b5f00) 00010000:00010000:1.0:1788970396.939922:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970396.939925:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.939930:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f25d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.940812:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f24f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d949 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.940834:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f264 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d949 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970396.940841:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:1.0:1788970396.940843:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970396.940845:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:1.0:1788970396.940905:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+15:12145:x1875871082289280:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1574us (1907us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788970396.940914:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:1.0:1788970396.952211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970396.952277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970396.952407:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082289536 00000100:00100000:0.0:1788970396.952422:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082289536 00000100:00100000:0.0:1788970396.952506:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:0.0:1788970396.952518:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+15:2400:x1875871082289536:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970396.952546:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970396.952582:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f264 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d949 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970396.952592:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082289408 00000100:00100000:3.0:1788970396.952603:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082289408 00010000:00010000:0.0:1788970396.952605:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:0.0:1788970396.952612:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970396.952666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 150 00000100:00100000:3.0:1788970396.952679:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:12145:x1875871082289408:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788970396.952692:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+15:2400:x1875871082289536:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 174us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970396.952701:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:3.0:1788970396.952795:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+14:12145:x1875871082289408:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 117us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970396.952807:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 150 00000100:00100000:0.0:1788970396.956196:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970396.956303:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082289664 00000100:00100000:3.0:1788970396.956316:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082289664 00000100:00100000:3.0:1788970396.956631:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 151 00000100:00100000:3.0:1788970396.956645:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:12145:x1875871082289664:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788970396.956768:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:12145:x1875871082289664:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 126us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970396.959993:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 151 00000040:00080000:0.0:1788970397.404814:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970397.404826:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970397.406123:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788970397.409354:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970397.469209:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102281216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970397.469321:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970397.469808:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281216 00000100:00100000:2.0:1788970397.469818:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281216 00000100:00100000:2.0:1788970397.469879:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788970397.469898:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102281216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970397.469939:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970397.469997:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102281216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970397.470004:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788970397.470180:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102281216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788970397.726534:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970397.789417:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788970398.492786:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf523c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102281600:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.492861:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970398.492921:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102282112:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.492945:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970398.492972:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102282624:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.492992:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970398.493002:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102281344:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.493016:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788970398.493021:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102281472:0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.493077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf521e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102281728:0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.498752:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970398.498752:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970398.498821:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102281856:0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.499331:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970398.500429:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281600 00000100:00100000:1.0:1788970398.500444:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281600 00000100:00100000:1.0:1788970398.500504:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281856 00000100:00100000:2.0:1788970398.500842:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102281984:0@lo:400:kworker.0 00000100:00100000:1.0:1788970398.500845:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281856 00000100:00100000:1.0:1788970398.500870:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788970398.500879:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102281600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.500892:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970398.500937:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102282368:0@lo:400:kworker.0 00000100:00100000:1.0:1788970398.500937:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102281600:12345-0@lo:400:kworker.0 Request processed in 59us (8076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970398.500944:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788970398.500961:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788970398.500967:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaeef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102281856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.500988:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970398.501004:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaeef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102281856:12345-0@lo:400:kworker.0 Request processed in 37us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970398.501010:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788970398.501022:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102282880:0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.501048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970398.501104:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf520780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102281856:0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.501140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281344 00000100:00100000:3.0:1788970398.501143:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281344 00000100:00100000:3.0:1788970398.501175:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788970398.501180:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102281344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.501232:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3650:x1875871102281344:12345-0@lo:400:kworker.0 Request processed in 37us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970398.501239:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788970398.504235:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102282496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504310:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970398.504359:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf523c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102281600:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504415:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282368 00000100:00100000:2.0:1788970398.504425:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282368 00000100:00100000:2.0:1788970398.504473:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282880 00000100:00100000:2.0:1788970398.504476:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282880 00000100:00100000:2.0:1788970398.504495:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788970398.504504:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102282368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504570:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102282368:12345-0@lo:400:kworker.0 Request processed in 67us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.504578:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788970398.504596:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788970398.504602:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102282880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504629:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102282880:12345-0@lo:400:kworker.0 Request processed in 28us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.504634:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788970398.504653:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282112 00000100:00100000:2.0:1788970398.504656:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282112 00000100:00100000:2.0:1788970398.504678:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282624 00000100:00100000:2.0:1788970398.504680:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282624 00000100:00100000:2.0:1788970398.504692:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281472 00000100:00100000:2.0:1788970398.504695:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281472 00000100:00100000:2.0:1788970398.504707:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281984 00000100:00100000:2.0:1788970398.504709:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281984 00000100:00100000:2.0:1788970398.504721:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282496 00000100:00100000:2.0:1788970398.504723:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282496 00000100:00100000:2.0:1788970398.504734:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788970398.504739:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102282112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504776:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102282112:12345-0@lo:400:kworker.0 Request processed in 36us (11829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.504783:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788970398.504796:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788970398.504803:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102282624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504844:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102282624:12345-0@lo:400:kworker.0 Request processed in 28us (11836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.504861:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788970398.504873:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788970398.504880:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102281472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504910:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102281472:12345-0@lo:400:kworker.0 Request processed in 31us (6165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.504916:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788970398.504926:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788970398.504932:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102281984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.504957:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102281984:12345-0@lo:400:kworker.0 Request processed in 26us (4065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.504963:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788970398.504973:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788970398.504979:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102282496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.505001:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102282496:12345-0@lo:400:kworker.0 Request processed in 23us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970398.505022:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:2.0:1788970398.505043:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970398.505047:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970398.505050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970398.505052:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970398.505458:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102283008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970398.505493:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970398.505585:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102283136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970398.505785:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102283008 00000100:00100000:0.0:1788970398.505792:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102283008 00000100:00100000:0.0:1788970398.505823:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788970398.505830:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102283008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970398.505853:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970398.505890:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102283008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970398.505896:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788970398.505950:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102283008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970398.505969:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970398.505991:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102282240:0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506011:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970398.506028:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102282752:0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970398.506069:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282240 00000100:00100000:0.0:1788970398.506073:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282240 00000100:00100000:0.0:1788970398.506103:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102282752 00000100:00100000:0.0:1788970398.506107:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102282752 00000100:00100000:0.0:1788970398.506124:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788970398.506140:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102282240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506177:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102282240:12345-0@lo:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970398.506185:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788970398.506195:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788970398.506200:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102282752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506231:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102282752:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970398.506237:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788970398.506256:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970398.506259:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970398.506274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102282240:0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102282752:0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506307:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102281728 00000100:00100000:0.0:1788970398.506310:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102281728 00000100:00100000:0.0:1788970398.506413:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788970398.506420:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102281728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506449:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102281728:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970398.506454:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788970398.506476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf521e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102281728:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.506681:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970398.506717:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102281472:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.506729:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102281984:0@lo:400:kworker.0 00000100:00100000:2.0:1788970398.506755:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102282496:0@lo:400:kworker.0 00010000:00080000:2.0:1788970398.506767:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83dfed00 x1875871102282112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970398.506777:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102282112:0@lo:400:kworker.0 00010000:00080000:2.0:1788970398.506786:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83dfda40 x1875871102282624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970398.506794:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102282624:0@lo:400:kworker.0 00000100:00100000:0.0:1788970398.506866:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102283136 00000100:00100000:0.0:1788970398.506871:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102283136 00000100:00100000:0.0:1788970398.506901:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788970398.506908:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102283136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970398.506929:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788970398.506967:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102283136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970398.506974:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788970398.507004:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102283136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970398.509717:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102281344:0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.509737:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788970398.509742:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d835c5680, transno 4294967313 00000100:00100000:3.0:1788970398.509762:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788970398.509775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102282880:0@lo:400:kworker.0 00010000:00010000:3.0:1788970398.753356:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970399.019043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.019081:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082289792 00000100:00100000:1.0:1788970399.019091:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082289792 00000100:00100000:1.0:1788970399.019161:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 152 00000100:00100000:1.0:1788970399.019172:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+14:12187:x1875871082289792:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970399.019193:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970399.019223:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d950 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019299:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019315:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019327:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019345:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019352:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019358:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019434:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019441:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019447:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019454:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970399.019458:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019465:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019477:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:1.0:1788970399.019480:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970399.019485:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019491:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019504:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019509:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019515:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019527:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970399.019531:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019537:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019545:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970399.019547:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970399.019550:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019555:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019588:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f272 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d950 expref: 15 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019598:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:1.0:1788970399.019601:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970399.019605:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d950 expref: 15 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.019613:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:1.0:1788970399.019674:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+14:12187:x1875871082289792:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 504us (641us total) trans 0 rc 301/301 00000100:00100000:1.0:1788970399.019682:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 152 00000100:00080000:1.0:1788970399.019705:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970399.038683:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.038750:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290048 00000100:00100000:2.0:1788970399.038760:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290048 00000100:00100000:2.0:1788970399.038815:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 153 00000100:00100000:2.0:1788970399.038889:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+14:12187:x1875871082290048:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:2.0:1788970399.038943:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970399.038970:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6ebd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d77b expref: 14 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.038985:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55bc700) 00010000:00010000:2.0:1788970399.038996:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970399.039056:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.039069:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.039079:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.039108:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.039127:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.039134:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040143:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040165:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040175:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970399.040190:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a59f8d2d reply state 00000000187e5022 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040200:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040207:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970399.040210:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970399.040221:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788970399.040225:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788970399.040232:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040239:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040253:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040259:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970399.040264:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040272:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040281:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:2.0:1788970399.040283:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970399.040287:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040293:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f287 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970399.040307:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a59f8d2d reply state 00000000187e5022 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040316:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.040323:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a7e88bd6f00) 00010000:00010000:2.0:1788970399.040325:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970399.040327:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788970399.040441:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+15:12187:x1875871082290048:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 1614us (1764us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788970399.040449:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 153 00000100:00100000:1.0:1788970399.139469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970399.139555:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290176 00000100:00100000:3.0:1788970399.139565:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290176 00000100:00100000:3.0:1788970399.139624:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 154 00000100:00100000:3.0:1788970399.139636:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+15:12195:x1875871082290176:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:3.0:1788970399.139660:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970399.139682:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f29c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d957 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.139770:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6f2a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.139786:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6f2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.139797:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6f2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970399.139842:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788970399.139846:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970399.139864:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6f2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.139889:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f29c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d957 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.139909:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6f2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d957 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.139917:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:3.0:1788970399.139920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970399.139923:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5e00, rc 0) 00000100:00100000:3.0:1788970399.139991:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+16:12195:x1875871082290176:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 356us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970399.139998:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 154 00000100:00100000:1.0:1788970399.224789:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.224889:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290304 00000100:00100000:0.0:1788970399.224899:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290304 00000100:00100000:0.0:1788970399.224963:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 155 00000100:00100000:0.0:1788970399.224973:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+16:12201:x1875871082290304:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970399.224994:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970399.225015:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f2aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d95e expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225080:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225096:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225108:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225126:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225131:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225145:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225257:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6f2bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225267:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225273:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970399.225309:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788970399.225313:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970399.225333:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6f2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225345:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225351:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225357:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225362:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970399.225365:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225372:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225413:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:0.0:1788970399.225422:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970399.225429:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225435:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f2b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225450:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225455:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225461:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225466:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970399.225469:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225474:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225481:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a7e88bd6f00) 00010000:00010000:0.0:1788970399.225484:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970399.225679:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225687:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f2b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225716:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f2aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d95e expref: 18 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225742:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6f2bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d95e expref: 17 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.225749:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970399.225751:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788970399.225753:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013200, rc 0) 00000100:00100000:0.0:1788970399.225808:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+17:12201:x1875871082290304:12345-192.168.203.15@tcp:101:bash.0 Request processed in 836us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970399.225815:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 155 00000100:00100000:2.0:1788970399.230575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.230659:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290560 00000100:00100000:0.0:1788970399.230668:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290560 00000100:00100000:0.0:1788970399.230720:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 156 00000100:00100000:0.0:1788970399.230795:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+17:12201:x1875871082290560:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970399.230821:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970399.230842:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f2c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d965 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.230961:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.230976:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.230987:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231041:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231063:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231070:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788970399.231659:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788970399.231904:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231915:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231922:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231955:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231962:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231968:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231974:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970399.231977:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.231984:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.232008:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970399.232011:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970399.232017:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.232024:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f2cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970399.232040:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb2e74b5 reply state 0000000014438b36 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.232051:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.232057:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:0.0:1788970399.232059:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970399.232063:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788970399.232098:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f2c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.232125:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.232307:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:0.0:1788970399.232310:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970399.232313:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012a00, rc 0) 00000100:00100000:0.0:1788970399.232461:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+20:12201:x1875871082290560:12345-192.168.203.15@tcp:101:bash.0 Request processed in 1671us (2082us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788970399.232470:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 156 00000100:00100000:3.0:1788970399.237377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.243475:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290688 00000100:00100000:2.0:1788970399.243491:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290688 00000100:00100000:2.0:1788970399.243566:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:2.0:1788970399.243579:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082290688:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970399.243598:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970399.243619:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d96c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970399.243643:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970399.243663:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1788970399.243667:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970399.243676:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.243718:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.243731:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99800, rc 0) 00000100:00100000:2.0:1788970399.243788:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082290688:12345-192.168.203.15@tcp:101:bash.0 Request processed in 214us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970399.243795:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00080000:1.0:1788970399.243997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970399.247778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.247878:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290816 00000100:00100000:0.0:1788970399.247889:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290816 00000100:00100000:0.0:1788970399.247960:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:0.0:1788970399.247972:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:12201:x1875871082290816:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970399.247990:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970399.248011:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d973 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.248044:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.248054:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970399.248058:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970399.248063:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.248117:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.248132:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970399.248148:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8442:1875871102283264:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970399.248270:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d825910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970399.254558:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8442:1875871102283264:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970399.254596:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.254635:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012400, rc 0) 00000100:00100000:0.0:1788970399.254714:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:12201:x1875871082290816:12345-192.168.203.15@tcp:101:bash.0 Request processed in 6742us (6944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970399.254725:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:3.0:1788970399.273162:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.275102:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082290944 00000100:00100000:0.0:1788970399.275125:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082290944 00010000:00010000:0.0:1788970399.275176:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970399.275238:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:0.0:1788970399.275462:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082290944:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970399.275482:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970399.275505:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.275519:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.275542:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb4e1cb/0xc3abfebe76c6f2e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d96c expref: 7 pid: 8441 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.275560:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970399.275565:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970399.275573:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.275599:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.275638:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970399.275653:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1875871102283392:192.168.203.15@tcp:105: 00000100:00100000:0.0:1788970399.275736:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d825910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970399.279453:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1875871102283392:192.168.203.15@tcp:105: 00010000:00010000:3.0:1788970399.279483:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970399.279542:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082290944:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 4295us (6390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970399.279554:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:2.0:1788970399.281467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970399.281688:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082291200 00000100:00100000:3.0:1788970399.281699:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082291200 00000100:00100000:3.0:1788970399.281753:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:3.0:1788970399.281762:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+20:12201:x1875871082291200:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1788970399.282043:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12201:x1875871082291200:12345-192.168.203.15@tcp:35:bash.0 Request processed in 280us (582us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788970399.282051:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1788970399.384178:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.384359:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082291456 00000100:00100000:1.0:1788970399.384371:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082291456 00000100:00100000:1.0:1788970399.384465:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 157 00000100:00100000:1.0:1788970399.384477:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12211:x1875871082291456:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970399.384505:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970399.384528:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f2f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d97a expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970399.384649:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788970399.386470:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f2f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d97a expref: 23 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.386491:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:1.0:1788970399.386494:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970399.386500:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f2f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d97a expref: 23 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.386515:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:1.0:1788970399.386647:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+22:12211:x1875871082291456:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2171us (2535us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788970399.386656:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 157 00000100:00100000:0.0:1788970399.390478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970399.390578:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082291712 00000100:00100000:3.0:1788970399.390589:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082291712 00000100:00100000:3.0:1788970399.390645:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:3.0:1788970399.390655:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+22:12211:x1875871082291712:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970399.391258:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:12211:x1875871082291712:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 601us (787us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788970399.391268:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:2.0:1788970399.477521:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.481945:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082291840 00000100:00100000:1.0:1788970399.481959:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082291840 00000100:00100000:1.0:1788970399.482039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:1.0:1788970399.482049:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+23:12217:x1875871082291840:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970399.482073:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970399.482093:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d981 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.482322:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f30c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.482338:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f30c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.482350:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f30c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970399.482412:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788970399.482416:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970399.482434:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f30c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.482460:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d981 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.482479:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f30c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d981 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.482487:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970399.482490:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970399.482494:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654a00, rc 0) 00000100:00100000:1.0:1788970399.482561:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:12217:x1875871082291840:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 513us (5048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970399.482574:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:0.0:1788970399.488839:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.488933:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082292096 00000100:00100000:2.0:1788970399.488943:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082292096 00000100:00100000:2.0:1788970399.489002:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:2.0:1788970399.489027:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+24:12217:x1875871082292096:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970399.489050:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970399.489069:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f313 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d988 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.489185:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f31a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.489208:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f31a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.489229:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f31a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970399.489241:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788970399.489351:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f313 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d988 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.489368:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f31a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d988 expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.489377:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:2.0:1788970399.489430:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970399.489435:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99800, rc 0) 00000100:00100000:2.0:1788970399.489713:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+26:12217:x1875871082292096:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 688us (883us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788970399.489721:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:0.0:1788970399.495152:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.495297:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082292352 00000100:00100000:1.0:1788970399.495309:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082292352 00000100:00100000:1.0:1788970399.495371:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:1.0:1788970399.495410:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+26:12217:x1875871082292352:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970399.495435:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970399.495457:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f328 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d98f expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.495581:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f32f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.495599:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.495612:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f32f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970399.495626:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788970399.495760:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f328 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d98f expref: 29 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.495779:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f32f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d98f expref: 28 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.495788:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:1.0:1788970399.495791:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788970399.495794:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:1.0:1788970399.495867:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+28:12217:x1875871082292352:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 487us (724us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788970399.495874:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:0.0:1788970399.496694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970399.496827:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082292480 00000100:00100000:3.0:1788970399.496835:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082292480 00000100:00100000:3.0:1788970399.496884:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1788970399.496893:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+28:2401:x1875871082292480:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970399.496905:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970399.496924:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f31a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d988 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.496946:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:3.0:1788970399.496950:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970399.496993:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+27:2401:x1875871082292480:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 101us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970399.497001:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1788970399.505480:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.505584:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082292608 00000100:00100000:0.0:1788970399.505593:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082292608 00000100:00100000:0.0:1788970399.505650:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:0.0:1788970399.505661:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2403:x1875871082292608:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:0.0:1788970399.505704:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.505724:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.505734:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970399.505739:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970399.505757:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.505792:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.505807:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 6 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970399.505822:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875871102283520:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970399.505915:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970399.509595:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970399.509668:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082292736 00000100:00100000:3.0:1788970399.509677:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082292736 00002000:00100000:3.0:1788970399.509718:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a7d83fefc00 x1875871082292736/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:175/0 lens 504/0 e 0 to 0 dl 1788970410 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970399.509730:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83fefc00 with x1875871082292736 ext(0->12) 00010000:00010000:3.0:1788970399.509740:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 7 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.509756:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 7 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970399.509764:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7d83fefc00 00000100:00100000:3.0:1788970399.509796:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970399.509806:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082292736:12345-192.168.203.15@tcp:4:lfs.0 00000100:00100000:3.0:1788970399.510708:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082292736:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 899us (1119us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788970399.510718:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00002000:00100000:3.0:1788970399.510727:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a7d83fefc00 x1875871082292736/t4294967306(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:175/0 lens 504/448 e 0 to 0 dl 1788970410 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970399.510751:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83fefc00 with x1875871082292736 ext(0->12) 00010000:00010000:3.0:1788970399.510759:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 9 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.510773:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 9 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970399.510781:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7d83fefc00 00000100:00100000:2.0:1788970399.510877:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875871102283520:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970399.510909:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970399.513652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.513768:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082292864 00000100:00100000:0.0:1788970399.513776:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082292864 00010000:00010000:0.0:1788970399.513813:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 9 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970399.513855:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:0.0:1788970399.513864:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2403:x1875871082292864:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970399.513878:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788970399.513896:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788970399.513899:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788970399 00002000:00010000:0.0:1788970399.513901:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788970399 00002000:00010000:0.0:1788970399.513904:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788970399 00002000:00010000:0.0:1788970399.513906:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788970399.513912:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 9 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.513947:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 9 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.513969:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000107a2f6a/0xc3abfebe76c6f2f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d973 expref: 9 pid: 8442 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.513988:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970399.513993:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970399.513999:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.514009:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.514144:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970399.514220:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082292864:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 349us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970399.514229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 81 00010000:00010000:2.0:1788970399.516076:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516095:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516185:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516272:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516282:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516290:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970399.516296:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516306:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516325:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.516350:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f33d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970399.516663:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082292608:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 11000us (11189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970399.516674:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1788970399.520124:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.520327:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082293120 00000100:00100000:2.0:1788970399.520338:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082293120 00000100:00100000:3.0:1788970399.520515:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1788970399.520528:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12217:x1875871082293120:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:3.0:1788970399.520596:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f32f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d98f expref: 27 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970399.520893:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788970399.520931:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788970399.521613:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1788970399.521659:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.521677:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 31 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.521687:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.521738:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 31 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.521755:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 31 pid: 6526 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970399.521769:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875871102283648:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970399.521854:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970399.525053:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.525160:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875871102283648:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970399.525229:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970399.525349:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082293248 00000100:00100000:3.0:1788970399.525358:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082293248 00010000:00010000:3.0:1788970399.525430:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 32 pid: 6526 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970399.525465:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 82 00000100:00100000:3.0:1788970399.525476:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+32:2402:x1875871082293248:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970399.525492:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970399.525500:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 32 pid: 6526 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.525525:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 32 pid: 6526 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.525549:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f2db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d965 expref: 32 pid: 6526 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.525567:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:3.0:1788970399.525573:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.525583:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.525591:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.525615:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970399.525662:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+31:2402:x1875871082293248:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 189us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970399.525671:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 82 00010000:00010000:1.0:1788970399.526187:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.526207:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970399.526325:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788970399.526467:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788970399.526553:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102283776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788970399.526599:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970399.526627:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970399.526878:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102283776 00000100:00100000:3.0:1788970399.526884:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102283776 00000100:00100000:3.0:1788970399.526934:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788970399.526943:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1875871102283776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788970399.527018:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1875871102283776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970399.527026:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788970399.527076:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102283776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788970399.527209:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788970399.527266:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102283904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788970399.527295:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970399.528966:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e91b31e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970399.529150:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102283904 00000100:00100000:1.0:1788970399.529157:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102283904 00000100:00100000:1.0:1788970399.529315:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788970399.529325:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1875871102283904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788970399.529529:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1875871102283904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 205us (2232us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788970399.529537:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788970399.529621:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e08b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102283904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788970399.529681:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788970399.529721:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.529746:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.529771:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.529778:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970399.529782:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.529791:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.529805:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:0.0:1788970399.529808:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788970399.529813:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.529820:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f344 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788970399.529926:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788970399.529983:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788970399.529994:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418796612635ns, next at 419796610433ns, rc = 0 00000001:00080000:0.0:1788970399.530000:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788970399.530022:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d831bbb00) 00010000:00010000:0.0:1788970399.530025:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788970399.530031:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f32f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d98f expref: 35 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970399.530133:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+34:12217:x1875871082293120:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 9608us (10029us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788970399.530151:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000020:00080000:0.0:1788970399.530156:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788970399.532956:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.533273:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082293376 00000100:00100000:1.0:1788970399.533283:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082293376 00000100:00100000:1.0:1788970399.533345:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1788970399.533356:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+34:12217:x1875871082293376:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970399.533427:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970399.533452:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f34b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d996 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.533525:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f34b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d996 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.533545:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f34b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d996 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970399.533565:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970399.533568:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970399.533573:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:1.0:1788970399.533639:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+35:12217:x1875871082293376:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 285us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970399.533646:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:1.0:1788970399.537774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.537978:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082293632 00000100:00100000:2.0:1788970399.537989:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082293632 00000100:00100000:2.0:1788970399.538054:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:2.0:1788970399.538065:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+35:12217:x1875871082293632:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970399.538622:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+36:12217:x1875871082293632:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 556us (856us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788970399.538630:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1788970399.630714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.630898:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082293888 00000100:00100000:2.0:1788970399.630911:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082293888 00000100:00100000:2.0:1788970399.631026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:2.0:1788970399.631037:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+36:12227:x1875871082293888:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970399.631064:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970399.631085:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d99d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970399.631208:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788970399.631348:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f352 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d99d expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.631363:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:2.0:1788970399.631366:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970399.631372:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d99d expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.631427:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215ae00, rc 0) 00000100:00100000:2.0:1788970399.631538:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12227:x1875871082293888:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 503us (833us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788970399.631546:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:2.0:1788970399.635745:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970399.635803:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082294016 00000100:00100000:3.0:1788970399.635811:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082294016 00000100:00100000:3.0:1788970399.635862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:3.0:1788970399.635872:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12227:x1875871082294016:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:3.0:1788970399.635944:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.635960:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.635972:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.635984:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.635991:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.635997:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636076:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636100:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636108:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970399.636158:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636171:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636178:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636185:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636351:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970399.636355:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636363:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636375:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:3.0:1788970399.636496:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970399.636505:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636512:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636532:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636539:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636544:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636549:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970399.636552:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636558:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636567:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:3.0:1788970399.636569:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970399.636572:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636578:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636588:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636594:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636600:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636611:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970399.636614:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636621:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636629:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970399.636631:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970399.636634:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970399.636640:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f36e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970399.636754:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12227:x1875871082294016:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 881us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970399.636763:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:0.0:1788970399.638555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.638657:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082294272 00000100:00100000:1.0:1788970399.638667:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082294272 00000100:00100000:1.0:1788970399.638722:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:1.0:1788970399.638740:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12227:x1875871082294272:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1788970399.638975:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+38:12227:x1875871082294272:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 235us (425us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788970399.638982:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1788970399.711493:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970399.711573:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082294528 00000100:00100000:0.0:1788970399.711586:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082294528 00000100:00100000:0.0:1788970399.711653:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:0.0:1788970399.711662:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+38:12230:x1875871082294528:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970399.711686:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970399.711706:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f375 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9a4 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711778:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711792:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711804:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711815:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711822:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711828:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711931:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711951:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.711959:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970399.711969:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788970399.712047:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712056:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712063:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712069:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970399.712073:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712081:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712092:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970399.712095:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970399.712100:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712105:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f37c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712119:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712132:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712138:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712142:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970399.712145:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712151:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712159:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:0.0:1788970399.712162:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970399.712165:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712171:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712219:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 41 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712235:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 40 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970399.712243:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970399.712245:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970399.712253:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012a00, rc 0) 00000100:00100000:0.0:1788970399.712318:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+40:12230:x1875871082294528:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 657us (832us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788970399.712326:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:3.0:1788970399.715072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970399.715599:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082294656 00000100:00100000:2.0:1788970399.715612:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082294656 00000100:00100000:2.0:1788970399.715678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 165 00000100:00100000:2.0:1788970399.715690:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+40:12230:x1875871082294656:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1788970399.715765:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715783:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715794:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715830:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715837:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715845:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715850:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970399.715866:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715874:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715886:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970399.715889:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970399.715894:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970399.715901:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970399.715977:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf521e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+40:12230:x1875871082294656:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 289us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970399.715985:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 165 00000100:00100000:2.0:1788970399.725434:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970399.725594:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082294912 00000100:00100000:1.0:1788970399.725604:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082294912 00000100:00100000:1.0:1788970399.725661:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1788970399.725686:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+40:12230:x1875871082294912:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1788970399.725904:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+41:12230:x1875871082294912:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 220us (478us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788970399.725911:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00010000:00010000:1.0:1788970399.772814:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970400.020792:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.020994:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082295168 00000100:00100000:0.0:1788970400.021008:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082295168 00000100:00100000:0.0:1788970400.021102:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 166 00000100:00100000:0.0:1788970400.021296:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf523c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+41:12261:x1875871082295168:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:0.0:1788970400.021330:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970400.021362:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f39f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9ab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.021688:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f3a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.021711:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.021727:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970400.021742:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788970400.021900:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f39f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ab expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.021924:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ab expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.021933:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970400.021957:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970400.021962:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012400, rc 0) 00000100:00100000:0.0:1788970400.022156:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf523c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12261:x1875871082295168:12345-192.168.203.15@tcp:101:cat.0 Request processed in 1042us (1376us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788970400.022165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 166 00000100:00100000:3.0:1788970400.028537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.028670:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082295296 00000100:00100000:0.0:1788970400.028684:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082295296 00000100:00100000:0.0:1788970400.028772:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:0.0:1788970400.028784:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+43:2402:x1875871082295296:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970400.028808:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970400.028844:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f3a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ab expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.028870:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970400.028877:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970400.029241:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+42:2402:x1875871082295296:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 458us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970400.029251:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:3.0:1788970400.032301:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.033059:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082295552 00000100:00100000:1.0:1788970400.033071:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082295552 00000100:00100000:1.0:1788970400.033155:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1788970400.033168:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+42:12261:x1875871082295552:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:1.0:1788970400.033960:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12261:x1875871082295552:12345-192.168.203.15@tcp:35:cat.0 Request processed in 790us (1668us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788970400.033969:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:3.0:1788970400.034161:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970400.034185:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102284032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970400.034617:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970400.034753:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102284032 00000100:00100000:1.0:1788970400.034760:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102284032 00000100:00100000:1.0:1788970400.034808:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788970400.034817:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102284032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970400.034846:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788970400.034894:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102284032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.034900:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970400.034987:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102284032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970400.035013:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102284160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970400.035060:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970400.035124:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102284160 00000100:00100000:1.0:1788970400.035129:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102284160 00000100:00100000:1.0:1788970400.035158:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970400.035165:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102284160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970400.035175:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788970400.035221:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102284160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.035233:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788970400.036442:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970400.036941:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102284160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970400.108697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.109250:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082295808 00000100:00100000:1.0:1788970400.109266:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082295808 00000100:00100000:1.0:1788970400.109349:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:1.0:1788970400.109362:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12267:x1875871082295808:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:1.0:1788970400.109437:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970400.109442:0:13652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788970400.109477:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f30c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d981 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.109501:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970400.109507:0:13652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970400.109526:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9b2 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.109666:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.109684:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 43 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.109706:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.109749:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 43 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.109767:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 43 pid: 10102 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970400.109806:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102284288:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970400.109949:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788970400.113734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970400.113915:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082295936 00000100:00100000:3.0:1788970400.113929:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082295936 00010000:00010000:3.0:1788970400.113982:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 44 pid: 10102 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970400.114035:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 83 00000100:00100000:3.0:1788970400.114047:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+44:2402:x1875871082295936:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970400.114115:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970400.114125:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 44 pid: 10102 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.114142:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 44 pid: 10102 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.114171:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970400.114178:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.114190:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.114199:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.114240:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970400.114413:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+44:2402:x1875871082295936:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 334us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970400.114446:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 83 00010000:00010000:1.0:1788970400.115307:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f38a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9a4 expref: 43 pid: 10102 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970400.115333:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102284288:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970400.115361:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.115372:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.115398:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970400.115425:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788970400.115605:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 44 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.115623:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 43 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.115633:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.115636:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970400.115640:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:1.0:1788970400.115688:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12267:x1875871082295808:12345-192.168.203.15@tcp:101:dd.0 Request processed in 6328us (7007us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788970400.115708:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 167 00000100:00100000:3.0:1788970400.127615:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.127673:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082296064 00000100:00100000:1.0:1788970400.127693:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082296064 00000100:00100000:1.0:1788970400.127776:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:1.0:1788970400.127789:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12267:x1875871082296064:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:1.0:1788970400.127825:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970400.127860:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f3c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9b9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.127907:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.127927:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.127943:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.128102:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f3c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.128125:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.128135:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.128138:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970400.128143:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:1.0:1788970400.128231:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+44:12267:x1875871082296064:12345-192.168.203.15@tcp:101:dd.0 Request processed in 444us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.128248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:0.0:1788970400.132150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970400.132523:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082296320 00000100:00100000:3.0:1788970400.132536:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082296320 00000100:00100000:3.0:1788970400.132613:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 169 00000100:00100000:3.0:1788970400.132625:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+44:12267:x1875871082296320:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:3.0:1788970400.132958:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.132981:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.132996:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970400.133501:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788970400.133540:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086d77163 reply state 00000000e137c3a8 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.133681:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.133692:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970400.133695:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970400.133700:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970400.133940:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+47:12267:x1875871082296320:12345-192.168.203.15@tcp:36:dd.0 Request processed in 1314us (1802us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788970400.133950:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 169 00000020:00080000:3.0:1788970400.133958:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788970400.330995:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.332822:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082296448 00000100:00100000:1.0:1788970400.332844:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082296448 00000100:00100000:1.0:1788970400.332989:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 170 00000100:00100000:1.0:1788970400.333002:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+47:12281:x1875871082296448:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:1.0:1788970400.333035:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970400.333063:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f3de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9c0 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333160:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333180:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333194:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333219:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333227:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333234:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333351:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333425:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 48 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333436:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333483:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 48 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.333500:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 48 pid: 13652 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970400.333517:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102284416:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970400.333654:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970400.337199:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102284416:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970400.337253:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970400.337548:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.337703:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082296704 00000100:00100000:2.0:1788970400.337712:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082296704 00000100:00100000:2.0:1788970400.337783:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:2.0:1788970400.337796:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+49:6172:x1875871082296704:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788970400.338215:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+50:6172:x1875871082296704:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 410us (657us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788970400.338224:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:0.0:1788970400.341606:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970400.342073:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082296832 00000100:00100000:3.0:1788970400.342087:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082296832 00010000:00010000:3.0:1788970400.342219:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 50 pid: 13652 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970400.342321:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 84 00000100:00100000:3.0:1788970400.342334:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+50:2403:x1875871082296832:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970400.342364:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970400.342374:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 50 pid: 13652 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.342428:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 50 pid: 13652 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.342455:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f3bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b2 expref: 50 pid: 13652 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.342477:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970400.342483:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.342493:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.342501:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.342533:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970400.342614:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+49:2403:x1875871082296832:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 282us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970400.342647:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 84 00010000:00010000:0.0:1788970400.343806:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.343820:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970400.343973:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788970400.343979:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970400.344023:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344040:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344052:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344059:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344068:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344074:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970400.344079:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344087:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344101:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970400.344104:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970400.344108:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344115:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f3e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344154:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344161:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344167:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344172:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970400.344174:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344181:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344190:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:0.0:1788970400.344192:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970400.344195:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344201:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f3ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344964:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f3de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c0 expref: 49 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.344987:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c0 expref: 48 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.345060:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970400.345063:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970400.345067:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9bc00, rc 0) 00000100:00100000:0.0:1788970400.345260:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+48:12281:x1875871082296448:12345-192.168.203.15@tcp:101:stat.0 Request processed in 12258us (14278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970400.345271:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 170 00000100:00100000:0.0:1788970400.413056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.413288:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082297088 00000100:00100000:1.0:1788970400.413302:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082297088 00000100:00100000:1.0:1788970400.413419:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 171 00000100:00100000:1.0:1788970400.413434:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+48:12287:x1875871082297088:12345-192.168.203.15@tcp:36:truncate.0 00010000:00010000:1.0:1788970400.413550:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970400.413598:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f3f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c0 expref: 48 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.413626:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.413633:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970400.413865:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.413888:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.413899:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970400.413952:0:10102:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788970400.413976:0:10102:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a3436c6 reply state 0000000034c75ba3 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.413989:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.413995:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.413998:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970400.414000:0:10102:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970400.414125:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+50:12287:x1875871082297088:12345-192.168.203.15@tcp:36:truncate.0 Request processed in 695us (1088us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788970400.414132:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 171 00000020:00080000:1.0:1788970400.414138:0:10102:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970400.588475:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.589251:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082297216 00000100:00100000:0.0:1788970400.589267:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082297216 00000100:00100000:0.0:1788970400.589359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 172 00000100:00100000:0.0:1788970400.589372:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+50:12301:x1875871082297216:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:0.0:1788970400.589434:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970400.589462:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f401 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9c7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589547:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589565:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589579:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589591:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589598:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589625:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589984:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.589996:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590004:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970400.590061:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788970400.590067:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970400.590094:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590110:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590120:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590127:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590135:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590142:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970400.590147:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590164:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590180:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970400.590183:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970400.590190:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590197:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f408 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590225:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590232:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590238:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590243:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970400.590246:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590252:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590260:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:0.0:1788970400.590262:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970400.590265:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590282:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013400/0xc3abfebe76c6f40f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590322:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f401 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 52 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590339:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.590347:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970400.590350:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970400.590352:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013800, rc 0) 00000100:00100000:0.0:1788970400.590525:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+51:12301:x1875871082297216:12345-192.168.203.15@tcp:101:stat.0 Request processed in 1155us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970400.590534:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 172 00000100:00100000:3.0:1788970400.678087:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.679042:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082297472 00000100:00100000:0.0:1788970400.679059:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082297472 00000100:00100000:0.0:1788970400.680824:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 173 00000100:00100000:0.0:1788970400.680856:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+51:12311:x1875871082297472:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970400.680894:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970400.680927:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f41d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9ce expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970400.682070:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788970400.683778:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f41d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ce expref: 53 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.683840:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:0.0:1788970400.683844:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970400.683851:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f41d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ce expref: 53 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.683879:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012800, rc 0) 00000100:00100000:0.0:1788970400.683997:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+52:12311:x1875871082297472:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 3158us (5929us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788970400.684007:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 173 00000100:00100000:3.0:1788970400.691071:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.692045:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082297728 00000100:00100000:2.0:1788970400.692063:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082297728 00000100:00100000:2.0:1788970400.692443:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:2.0:1788970400.692457:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+52:12311:x1875871082297728:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970400.693172:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+53:12311:x1875871082297728:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 716us (2113us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788970400.693192:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1788970400.748182:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.751502:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082297984 00000100:00100000:2.0:1788970400.751526:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082297984 00000100:00100000:2.0:1788970400.751727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 174 00000100:00100000:2.0:1788970400.751741:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf520780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+53:12317:x1875871082297984:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970400.751785:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970400.751813:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f42b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9d5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.751968:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.751987:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.751998:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.752049:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.752065:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 54 pid: 6525 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970400.752162:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dfed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102284544:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970400.752425:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970400.756636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.756876:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dfed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102284544:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970400.756917:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970400.757002:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082298112 00000100:00100000:0.0:1788970400.757011:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082298112 00010000:00010000:0.0:1788970400.757061:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 55 pid: 6525 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970400.757117:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 85 00000100:00100000:0.0:1788970400.757128:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+55:2402:x1875871082298112:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970400.757147:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970400.757154:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 55 pid: 6525 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.757166:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 55 pid: 6525 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.757273:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9c7 expref: 55 pid: 6525 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.757317:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970400.757322:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.757333:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.757343:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.757483:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970400.757547:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+54:2402:x1875871082298112:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 419us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970400.757556:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 85 00010000:00010000:1.0:1788970400.760233:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.760256:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970400.760289:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788970400.761240:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f42b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 55 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.761308:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.761319:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.761323:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970400.761327:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215a200, rc 0) 00000100:00100000:1.0:1788970400.761459:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf520780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+54:12317:x1875871082297984:12345-192.168.203.15@tcp:101:bash.0 Request processed in 9720us (13290us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788970400.761471:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 174 00000100:00100000:3.0:1788970400.763572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.763682:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082298368 00000100:00100000:2.0:1788970400.763695:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082298368 00000100:00100000:2.0:1788970400.763770:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 175 00000100:00100000:2.0:1788970400.763782:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+54:12317:x1875871082298368:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:2.0:1788970400.764122:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.764144:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.764159:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970400.764227:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788970400.764250:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051b76b7f reply state 00000000c1c9293a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.764264:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.764273:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970400.764277:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970400.764290:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970400.764432:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+57:12317:x1875871082298368:12345-192.168.203.15@tcp:36:bash.0 Request processed in 651us (870us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788970400.764441:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 175 00000020:00080000:2.0:1788970400.764446:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970400.777993:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.779311:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082298496 00000100:00100000:0.0:1788970400.779328:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082298496 00000100:00100000:0.0:1788970400.779459:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 176 00000100:00100000:0.0:1788970400.779471:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+57:12317:x1875871082298496:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970400.779502:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970400.779533:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f447 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9dc expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.779652:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.779671:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.779703:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.779748:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970400.779763:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 58 pid: 6526 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970400.779780:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102284672:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970400.779990:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d825916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970400.788415:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.788951:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082298624 00000100:00100000:2.0:1788970400.788965:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082298624 00010000:00010000:2.0:1788970400.789022:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 59 pid: 6526 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970400.789084:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:2.0:1788970400.789096:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+59:2402:x1875871082298624:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970400.789122:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970400.789131:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 59 pid: 6526 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.789146:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 59 pid: 6526 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.789178:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970400.789185:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.789257:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.789266:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.789296:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970400.789638:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f432 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9d5 expref: 59 pid: 6526 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970400.789662:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102284672:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970400.789817:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.789830:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.789836:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970400.789917:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788970400.790351:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970400.790532:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.790578:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f447 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9dc expref: 59 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.790617:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9dc expref: 58 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.790625:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.790628:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970400.790631:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012800, rc 0) 00000100:00100000:2.0:1788970400.790804:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+58:2402:x1875871082298624:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 1708us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970400.790815:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 86 00000100:00100000:1.0:1788970400.791580:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+57:12317:x1875871082298496:12345-192.168.203.15@tcp:101:bash.0 Request processed in 12107us (13598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.791590:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 176 00000100:00100000:0.0:1788970400.796241:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.796354:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082298880 00000100:00100000:1.0:1788970400.796367:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082298880 00000100:00100000:1.0:1788970400.796470:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:1.0:1788970400.796482:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+57:12317:x1875871082298880:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:1.0:1788970400.796761:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+58:12317:x1875871082298880:12345-192.168.203.15@tcp:35:bash.0 Request processed in 280us (532us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788970400.796768:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00010000:00010000:3.0:1788970400.797332:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970400.867373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.867539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082299136 00000100:00100000:1.0:1788970400.867554:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082299136 00000100:00100000:1.0:1788970400.867643:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 177 00000100:00100000:1.0:1788970400.867655:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+58:12327:x1875871082299136:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970400.867693:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970400.867735:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f455 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9e3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970400.867871:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788970400.868031:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f455 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9e3 expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.868048:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:1.0:1788970400.868051:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970400.868060:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f455 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9e3 expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.868077:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9bc00, rc 0) 00000100:00100000:1.0:1788970400.868187:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12327:x1875871082299136:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 534us (831us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788970400.868196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 177 00000100:00100000:0.0:1788970400.873443:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.873597:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082299264 00000100:00100000:2.0:1788970400.873611:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082299264 00000100:00100000:2.0:1788970400.873696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 178 00000100:00100000:2.0:1788970400.873711:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12327:x1875871082299264:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:2.0:1788970400.873836:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.873860:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.873875:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.873890:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.873899:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.873906:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874023:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874035:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874071:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970400.874178:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874198:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874220:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874227:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874232:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970400.874237:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874245:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874258:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970400.874261:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970400.874268:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874274:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f463 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874292:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874305:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874310:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874315:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970400.874319:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874325:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874333:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:2.0:1788970400.874336:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970400.874339:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874345:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f46a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874356:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874361:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874367:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874372:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970400.874528:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874537:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874546:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970400.874549:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970400.874553:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970400.874559:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970400.874682:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12327:x1875871082299264:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 973us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970400.874691:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 178 00000100:00100000:3.0:1788970400.880962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.881108:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082299520 00000100:00100000:1.0:1788970400.881123:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082299520 00000100:00100000:1.0:1788970400.881216:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:1.0:1788970400.881231:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12327:x1875871082299520:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1788970400.881611:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+60:12327:x1875871082299520:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 382us (663us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788970400.881621:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:0.0:1788970400.911273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.911596:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082299776 00000100:00100000:1.0:1788970400.911613:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082299776 00000100:00100000:1.0:1788970400.911714:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 179 00000100:00100000:1.0:1788970400.911729:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+60:12330:x1875871082299776:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970400.911764:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970400.911792:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f478 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9ea expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.911946:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.911967:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.911983:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.911995:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912002:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912008:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912191:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f48d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912213:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912222:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f48d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970400.912234:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788970400.912356:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912373:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912431:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912440:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ac00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970400.912447:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912457:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912477:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970400.912481:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970400.912487:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912494:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6f47f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912513:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912519:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912526:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912531:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970400.912544:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912551:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912560:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:1.0:1788970400.912564:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970400.912568:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912575:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6f486 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912628:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6f478 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ea expref: 63 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912643:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f48d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ea expref: 62 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.912651:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.912653:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970400.912656:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3000, rc 0) 00000100:00100000:1.0:1788970400.913354:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+62:12330:x1875871082299776:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1625us (2095us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788970400.913366:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 179 00000100:00100000:0.0:1788970400.921460:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.921517:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970400.921771:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082299904 00000100:00100000:3.0:1788970400.921784:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082299904 00000100:00100000:3.0:1788970400.921870:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:3.0:1788970400.921882:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+62:2403:x1875871082299904:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970400.921902:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970400.921935:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f48d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ea expref: 62 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970400.921959:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970400.921966:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970400.922042:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+61:2403:x1875871082299904:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 161us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970400.922051:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1788970400.922243:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300032 00000100:00100000:1.0:1788970400.922248:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300032 00000100:00100000:1.0:1788970400.922303:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:1.0:1788970400.922312:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+61:12330:x1875871082300032:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1788970400.922452:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922473:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922486:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922537:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922546:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922555:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922575:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970400.922582:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922592:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922603:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970400.922606:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970400.922611:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970400.922617:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f49b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970400.922679:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+61:12330:x1875871082300032:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 368us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.922687:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 180 00000100:00100000:3.0:1788970400.925450:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970400.925689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300288 00000100:00100000:2.0:1788970400.925703:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300288 00000100:00100000:2.0:1788970400.925781:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:2.0:1788970400.925794:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+61:12330:x1875871082300288:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970400.926122:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+62:12330:x1875871082300288:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 329us (737us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788970400.926131:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1788970400.964107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.964158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.964219:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.964252:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.964277:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300672 00000100:00100000:0.0:1788970400.964288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970400.964293:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300672 00000100:00100000:0.0:1788970400.964315:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970400.964347:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300928 00000100:00100000:0.0:1788970400.964353:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300928 00000100:00100000:1.0:1788970400.964426:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300800 00000100:00100000:1.0:1788970400.964431:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300800 00000100:00100000:0.0:1788970400.964455:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:0.0:1788970400.964471:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082300672:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970400.964480:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:1.0:1788970400.964490:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082300800:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970400.964660:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300544 00000100:00100000:3.0:1788970400.964666:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300544 00000100:00100000:3.0:1788970400.964704:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082301056 00000100:00100000:3.0:1788970400.964708:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082301056 00000100:00100000:3.0:1788970400.964726:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 308 00000100:00100000:3.0:1788970400.964733:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082300928:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970400.964814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082300416 00000100:00100000:2.0:1788970400.964819:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082300416 00000100:00100000:2.0:1788970400.964862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 383 00000100:00100000:2.0:1788970400.964870:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082300416:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970400.964958:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2402:x1875871082300672:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 491us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970400.964966:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:0.0:1788970400.965002:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 309 00000100:00100000:1.0:1788970400.965011:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082300800:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 520us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970400.965013:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082300544:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970400.965029:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:1.0:1788970400.965062:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 310 00000100:00100000:0.0:1788970400.965067:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082300544:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 53us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.965075:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082301056:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970400.965085:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 309 00000100:00100000:1.0:1788970400.965112:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082301056:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 39us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970400.965177:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 310 00000100:00080000:0.0:1788970400.965315:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970400.965323:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970400.965329:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970400.968350:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082300928:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 3597us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970400.968370:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 308 00000100:00100000:2.0:1788970400.968998:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082300416:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 4121us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970400.969029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 383 00000100:00100000:0.0:1788970401.053370:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102284800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970401.053486:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970401.053690:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102284800 00000100:00100000:2.0:1788970401.053700:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102284800 00000100:00100000:2.0:1788970401.053779:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788970401.053792:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102284800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970401.053847:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788970401.053923:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102284800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970401.053931:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788970401.054096:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102284800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970401.077255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.078094:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082301312 00000100:00100000:1.0:1788970401.078169:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082301312 00000100:00100000:1.0:1788970401.078330:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00100000:1.0:1788970401.078343:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+62:12348:x1875871082301312:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1788970401.078398:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970401.078428:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f4a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9f1 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.078622:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f4a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.078644:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.078659:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f4a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970401.078684:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788970401.078832:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f4a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9f1 expref: 65 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.078857:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f4a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9f1 expref: 64 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.078867:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970401.078871:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788970401.078876:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3c00, rc 0) 00000100:00100000:1.0:1788970401.078966:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12348:x1875871082301312:12345-192.168.203.15@tcp:101:cat.0 Request processed in 625us (1727us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788970401.078975:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 181 00000100:00080000:0.0:1788970401.085492:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970401.112895:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.112995:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082301440 00000100:00100000:1.0:1788970401.113009:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082301440 00000100:00100000:1.0:1788970401.113135:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:1.0:1788970401.113144:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12349:x1875871082301440:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970401.113173:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970401.113229:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f4b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9f8 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.113500:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f4be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.113520:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f4be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.113534:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f4be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970401.113594:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788970401.113598:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970401.113691:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f4be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.113790:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f4b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9f8 expref: 66 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.113813:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f4be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9f8 expref: 65 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.113821:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970401.113824:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970401.113828:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2e00, rc 0) 00000100:00100000:1.0:1788970401.113910:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12349:x1875871082301440:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 766us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.113918:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 182 00000100:00100000:3.0:1788970401.119544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.119685:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082301824 00000100:00100000:2.0:1788970401.119699:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082301824 00000100:00100000:2.0:1788970401.119828:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:2.0:1788970401.119851:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12349:x1875871082301824:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970401.120308:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12349:x1875871082301824:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 468us (778us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788970401.120316:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1788970401.122772:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.122983:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082301952 00000100:00100000:3.0:1788970401.122997:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082301952 00000100:00100000:3.0:1788970401.123079:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1788970401.123091:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12349:x1875871082301952:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:3.0:1788970401.123117:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788970401.123491:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f44e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9dc expref: 66 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.123526:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f4a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9f1 expref: 65 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.123543:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f34b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d996 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.123554:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970401.123560:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970401.123670:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12349:x1875871082301952:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 581us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.123679:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970401.127803:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.127849:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082302080 00000100:00100000:3.0:1788970401.127863:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082302080 00000100:00100000:3.0:1788970401.127940:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:3.0:1788970401.127953:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12349:x1875871082302080:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:3.0:1788970401.128133:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.128158:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.128174:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970401.128331:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788970401.128465:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12349:x1875871082302080:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 514us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.128474:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 183 00000100:00100000:0.0:1788970401.154762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.155363:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082302208 00000100:00100000:2.0:1788970401.155427:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082302208 00000100:00100000:2.0:1788970401.155514:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 184 00000100:00100000:2.0:1788970401.155528:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12351:x1875871082302208:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970401.155561:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970401.155595:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f4cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8d9ff expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155692:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155722:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155736:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155751:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155758:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155764:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155857:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155867:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155875:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970401.155931:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788970401.155936:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970401.155959:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155974:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.155994:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156001:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156009:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156016:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215ae00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.156021:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156029:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156044:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970401.156047:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.156054:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156061:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156078:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156084:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156089:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156101:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.156105:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156111:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156120:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:2.0:1788970401.156123:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.156126:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156132:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f4da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156163:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f4cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156182:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.156189:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.156192:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970401.156194:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215bc00, rc 0) 00000100:00100000:2.0:1788970401.157631:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12351:x1875871082302208:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2094us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970401.157645:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 184 00000040:00080000:0.0:1788970401.500621:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970401.500633:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970401.500770:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788970401.500780:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970401.500987:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102284928:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970401.501174:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970401.511257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.511553:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102284928:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970401.513408:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082302336 00000100:00100000:1.0:1788970401.513440:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082302336 00000100:00100000:1.0:1788970401.513604:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:1.0:1788970401.513618:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12362:x1875871082302336:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970401.513734:0:13652:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970401.514296:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12362:x1875871082302336:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 679us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.516089:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 185 00000100:00100000:0.0:1788970401.529396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.529551:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082302464 00000100:00100000:1.0:1788970401.529573:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082302464 00000100:00100000:1.0:1788970401.529658:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:1.0:1788970401.529672:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12362:x1875871082302464:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788970401.529792:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.529817:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.529834:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.529855:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.529862:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.529868:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530331:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530357:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530377:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970401.530617:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788970401.530623:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970401.530640:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530653:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530660:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530666:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530672:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970401.530676:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530683:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.530696:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:1.0:1788970401.530699:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970401.530703:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.537945:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f4e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.537973:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.537981:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.537989:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.537996:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970401.538002:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538011:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538033:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8a7eb55b5500) 00010000:00010000:1.0:1788970401.538037:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970401.538043:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538048:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f4ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538069:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538074:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538110:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538115:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970401.538119:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538125:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538135:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:1.0:1788970401.538137:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970401.538140:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.538146:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f4f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970401.538296:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12362:x1875871082302464:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 8620us (8935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.538309:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 186 00000100:00100000:2.0:1788970401.545262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.545311:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082302720 00000100:00100000:2.0:1788970401.545325:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082302720 00000100:00100000:2.0:1788970401.545411:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:2.0:1788970401.545423:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12362:x1875871082302720:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970401.545452:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970401.545480:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da06 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547072:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547111:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547126:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970401.547140:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788970401.547368:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547377:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547410:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547417:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.547422:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547449:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547463:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.547466:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970401.547473:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547480:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547541:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da06 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547553:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:2.0:1788970401.547555:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970401.547755:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f4fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da06 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.547768:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215ae00, rc 0) 00000100:00100000:2.0:1788970401.547857:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12362:x1875871082302720:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2435us (2608us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788970401.547867:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 187 00000100:00100000:0.0:1788970401.552295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.552426:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082302848 00000100:00100000:2.0:1788970401.552440:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082302848 00000100:00100000:2.0:1788970401.552511:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:2.0:1788970401.552522:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12362:x1875871082302848:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970401.552585:0:13652:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970401.552729:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12362:x1875871082302848:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 208us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970401.552738:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 188 00000100:00100000:0.0:1788970401.563740:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.563962:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082303104 00000100:00100000:1.0:1788970401.563977:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082303104 00000100:00100000:1.0:1788970401.564060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:1.0:1788970401.564072:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12362:x1875871082303104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970401.564102:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970401.564106:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788970401.564148:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f4be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9f8 expref: 65 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.564190:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970401.564204:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970401.564223:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f512 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da0d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970401.564766:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788970401.564918:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f519 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.564935:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.564948:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.565008:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f512 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da0d expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.565024:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da0d expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.565032:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7eb55b5500) 00010000:00010000:1.0:1788970401.565035:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970401.565038:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2800, rc 0) 00000100:00100000:1.0:1788970401.565113:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12362:x1875871082303104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1042us (1387us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788970401.565121:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 189 00000100:00100000:2.0:1788970401.568588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970401.572157:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082303360 00000100:00100000:0.0:1788970401.572194:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082303360 00000100:00100000:0.0:1788970401.572298:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:0.0:1788970401.572312:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12362:x1875871082303360:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788970401.572508:0:10102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970401.572548:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da0d expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572574:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7eb55b5500) 00010000:00010000:0.0:1788970401.572588:0:10102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970401.572636:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572655:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572666:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572684:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572691:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572721:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572787:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572794:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572802:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572808:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970401.572814:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572823:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572832:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970401.572835:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970401.572840:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572847:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f527 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572858:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572864:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.572875:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.573010:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970401.573015:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.573022:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.573032:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xce66ec08 (ffff8a7d831bbb00) 00010000:00010000:0.0:1788970401.573035:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970401.573039:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.573045:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f52e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xce66ec08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970401.573220:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12362:x1875871082303360:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 909us (4647us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788970401.573227:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 190 00000100:00100000:0.0:1788970401.586343:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.586709:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082303488 00000100:00100000:2.0:1788970401.586724:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082303488 00000100:00100000:2.0:1788970401.586853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:2.0:1788970401.586867:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12362:x1875871082303488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970401.586907:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970401.586945:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f535 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da14 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.586994:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.587012:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.587028:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.587208:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f535 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.587234:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.587259:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:2.0:1788970401.587263:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970401.587268:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215a200, rc 0) 00000100:00100000:2.0:1788970401.587358:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12362:x1875871082303488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 495us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970401.587366:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 191 00000100:00100000:0.0:1788970401.591708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.592175:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082303744 00000100:00100000:3.0:1788970401.592211:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082303744 00000100:00100000:2.0:1788970401.592295:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:2.0:1788970401.592315:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12362:x1875871082303744:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970401.592462:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.592488:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.592504:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970401.592749:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788970401.592762:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420859380402ns, next at 421859376902ns, rc = 0 00000004:00010000:2.0:1788970401.592844:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7a7e129 reply state 0000000036ebfa5b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.592863:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.592872:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:2.0:1788970401.592875:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788970401.592907:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970401.593074:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+68:12362:x1875871082303744:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 766us (1381us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788970401.594075:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 192 00000100:00100000:0.0:1788970401.596346:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.596624:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082303872 00000100:00100000:2.0:1788970401.596637:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082303872 00000100:00100000:2.0:1788970401.596716:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:2.0:1788970401.596729:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+68:12362:x1875871082303872:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970401.596762:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970401.596790:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da1b expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.596865:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 69 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.596883:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 69 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.596907:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:2.0:1788970401.596911:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970401.596915:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99800, rc 0) 00000100:00100000:2.0:1788970401.599468:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+69:12362:x1875871082303872:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2718us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970401.599487:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 193 00000100:00100000:1.0:1788970401.602242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970401.602435:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082304000 00000100:00100000:0.0:1788970401.602452:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082304000 00000100:00100000:0.0:1788970401.602527:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:0.0:1788970401.602540:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+6:2400:x1875871082304000:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788970401.602843:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2400:x1875871082304000:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 305us (614us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788970401.602851:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1788970401.606952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.607030:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082304256 00000100:00100000:3.0:1788970401.607047:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082304256 00000100:00100000:3.0:1788970401.607115:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1788970401.607127:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+69:12362:x1875871082304256:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788970401.607427:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+70:12362:x1875871082304256:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 301us (488us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788970401.607438:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1788970401.611749:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.611841:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082304512 00000100:00100000:1.0:1788970401.611858:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082304512 00000100:00100000:1.0:1788970401.611940:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:1.0:1788970401.611955:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+70:12362:x1875871082304512:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970401.612130:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+70:12362:x1875871082304512:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 179us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.612138:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 194 00000100:00100000:1.0:1788970401.616540:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.619842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082304640 00000100:00100000:2.0:1788970401.619865:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082304640 00000100:00100000:1.0:1788970401.620043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:1.0:1788970401.620057:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+70:12362:x1875871082304640:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970401.620080:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970401.620101:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f551 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.620170:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.620184:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.620204:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970401.620248:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970401.620270:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.620318:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c6f551 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da22 expref: 72 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.620337:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da22 expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.620347:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:1.0:1788970401.620350:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788970401.620353:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2400, rc 0) 00000100:00100000:1.0:1788970401.620462:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+71:12362:x1875871082304640:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 406us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.620472:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 195 00000100:00100000:3.0:1788970401.623916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970401.624011:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082304768 00000100:00100000:0.0:1788970401.624025:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082304768 00000100:00100000:0.0:1788970401.624097:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970401.624109:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2400:x1875871082304768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970401.624133:0:10104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970401.624160:0:10104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da29 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970401.624194:0:10104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa185a1, blocks: 0x0 00010000:00010000:0.0:1788970401.624233:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1788970401.624239:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970401.624250:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 8 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.624270:0:10104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 8 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.624289:0:10104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012600, rc 0) 00000100:00100000:0.0:1788970401.624371:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2400:x1875871082304768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 264us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970401.624405:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970401.632628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.633465:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305024 00000100:00100000:3.0:1788970401.633485:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305024 00000100:00100000:3.0:1788970401.633547:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 196 00000100:00100000:3.0:1788970401.633559:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+71:12362:x1875871082305024:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970401.633675:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+71:12362:x1875871082305024:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 118us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.633683:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 196 00000100:00100000:1.0:1788970401.640669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.640736:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305152 00000100:00100000:3.0:1788970401.640745:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305152 00000100:00100000:3.0:1788970401.640797:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:3.0:1788970401.640807:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:12362:x1875871082305152:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970401.640825:0:8689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970401.640843:0:8689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da30 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.640875:0:8689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.640884:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970401.640888:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970401.640894:0:8689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 9 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.640928:0:8689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.640942:0:8689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.640966:0:8689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8689:1875871102285056:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970401.641051:0:8689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d826689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970401.650531:0:8689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8689:1875871102285056:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970401.650578:0:8689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 9 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.650603:0:8689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5c00, rc 0) 00000100:00100000:1.0:1788970401.650666:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:12362:x1875871082305152:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 9860us (10004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.650675:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1788970401.657248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.657319:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305280 00000100:00100000:3.0:1788970401.657331:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305280 00010000:00010000:3.0:1788970401.657370:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.657440:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:3.0:1788970401.657451:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082305280:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970401.657465:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970401.657485:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.657501:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.657523:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7f74c0/0xc3abfebe76c6f55f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da29 expref: 9 pid: 10104 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.657541:0:7932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970401.657545:0:7932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970401.657553:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.657576:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.657614:0:7932:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.657629:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7932:1875871102285184:192.168.203.15@tcp:105: 00000100:00100000:3.0:1788970401.657713:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668300 going to sleep for 11 seconds 00000100:00100000:1.0:1788970401.661063:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7932:1875871102285184:192.168.203.15@tcp:105: 00010000:00010000:1.0:1788970401.661092:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970401.661162:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082305280:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 3713us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.661192:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 87 00000100:00100000:1.0:1788970401.668822:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.673127:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305408 00000100:00100000:3.0:1788970401.673144:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305408 00002000:00100000:3.0:1788970401.673329:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a7d83ee7840 x1875871082305408/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:177/0 lens 504/0 e 0 to 0 dl 1788970412 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970401.673341:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83ee7840 with x1875871082305408 ext(0->8) 00002000:00010000:3.0:1788970401.673347:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83ee7840 00000100:00100000:3.0:1788970401.673403:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:3.0:1788970401.673416:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082305408:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788970401.674750:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2403:x1875871082305408:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 1333us (5934us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788970401.674761:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00002000:00100000:3.0:1788970401.674771:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a7d83ee7840 x1875871082305408/t4294967315(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:177/0 lens 504/448 e 0 to 0 dl 1788970412 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970401.674780:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83ee7840 with x1875871082305408 ext(0->8) 00002000:00010000:3.0:1788970401.674786:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83ee7840 00000100:00100000:3.0:1788970401.683027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.686031:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305536 00000100:00100000:1.0:1788970401.686045:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305536 00000100:00100000:1.0:1788970401.688183:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:1.0:1788970401.688216:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+71:12362:x1875871082305536:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788970401.709070:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788970401.709089:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:2.0:1788970401.709192:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709230:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709238:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709244:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709249:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709257:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709275:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a7e88bd6f00) 00010000:00010000:2.0:1788970401.709278:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.709284:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709291:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f28e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709311:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709318:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709324:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709329:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709338:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709345:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709355:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970401.709357:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.709360:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709366:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f295 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709415:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709423:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709429:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709434:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709436:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709442:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709451:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d831bb500) 00010000:00010000:2.0:1788970401.709454:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.709465:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709471:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013600/0xc3abfebe76c6f2d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709492:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709499:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709505:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709511:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709514:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709520:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709528:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.709531:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.709534:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709540:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f3d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709551:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709557:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709569:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709574:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709578:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709585:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709593:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.709596:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.709599:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709604:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a800/0xc3abfebe76c6f3fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709616:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709621:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709627:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709632:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709634:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709651:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709660:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.709662:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.709665:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709670:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f440 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709683:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709689:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709695:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709700:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.709703:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709708:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709716:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:2.0:1788970401.709718:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788970401.709722:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.709738:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f543 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970401.709925:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788970401.709945:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7e92b6a6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788970401.709949:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d83332200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7e92b6ab40 00000020:00080000:1.0:1788970401.709953:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d83332900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d8217c200 00000100:00100000:1.0:1788970401.710217:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+19:12362:x1875871082305536:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 22017us (27194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.710229:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 197 00000100:00100000:0.0:1788970401.710605:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102285312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788970401.710670:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970401.710746:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102285312 00000100:00100000:0.0:1788970401.710907:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102285312 00000100:00100000:0.0:1788970401.710964:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970401.710973:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1875871102285312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788970401.710996:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1788970401.711024:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa1859f, atime: 0x6aa1859f, ctime: 0x6aa1859f, blocks: 0x8 00010000:00010000:0.0:1788970401.711031:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.711046:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1788970401.711050:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970401.711056:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.711071:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.711081:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.711088:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788970401.711167:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1788970401.711329:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788970401.711412:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788970401.711420:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970401.711430:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102285440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788970401.711460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970401.711496:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102285440 00000100:00100000:2.0:1788970401.711500:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102285440 00000100:00100000:2.0:1788970401.711528:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970401.711535:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102285440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788970401.711624:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788970401.711627:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788970401 00002000:00010000:2.0:1788970401.711630:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788970401.711633:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788970401 -> 1788970401 00002000:00010000:2.0:1788970401.711635:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788970401.711670:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102285440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (207us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788970401.711677:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1788970401.711721:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e4cf00/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788970401.711727:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102285440:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788970401.712224:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788970401.712356:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102285312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1383us (1684us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788970401.712371:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:2.0:1788970401.712938:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83ed8f00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788970401.712945:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102285312:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788970401.713052:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970401.713060:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.713071:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970401.713075:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.713086:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.713243:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.713250:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6f56d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.713272:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970401.713273:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970401.713275:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970401.713928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.713990:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305664 00000100:00100000:2.0:1788970401.713998:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305664 00000100:00100000:2.0:1788970401.714078:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:2.0:1788970401.714088:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2400:x1875871082305664:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788970401.717155:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1788970401.717168:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788970401.717920:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2400:x1875871082305664:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 3828us (3990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.717931:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:2.0:1788970401.724313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.727658:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082305920 00000100:00100000:3.0:1788970401.727675:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082305920 00000100:00100000:3.0:1788970401.727755:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:3.0:1788970401.727771:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:12362:x1875871082305920:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970401.727826:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970401.727853:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da22 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.727873:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:3.0:1788970401.727878:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970401.727914:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.727930:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.727941:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970401.728065:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b86332c7 reply state 000000000eceddf9 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.728078:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.728085:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:3.0:1788970401.728088:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970401.728090:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970401.728207:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:12362:x1875871082305920:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 442us (3901us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788970401.731643:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 198 00000100:00100000:2.0:1788970401.731861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970401.731936:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082306048 00000100:00100000:0.0:1788970401.731946:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082306048 00000100:00100000:0.0:1788970401.731995:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970401.732005:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082306048:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788970401.732156:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788970401.732160:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788970401 -> 1788970400 00002000:00010000:0.0:1788970401.732163:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788970399 00002000:00010000:0.0:1788970401.732165:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788970401 -> 1788970400 00002000:00010000:0.0:1788970401.732167:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788970401.732238:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082306048:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 234us (377us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788970401.732246:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970401.737522:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.737604:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082306304 00000100:00100000:3.0:1788970401.737616:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082306304 00000100:00100000:3.0:1788970401.737676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:3.0:1788970401.737688:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+20:12362:x1875871082306304:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788970401.737760:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.737779:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.737789:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.737825:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.737838:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 20 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.737853:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102285568:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970401.737950:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970401.740539:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.740574:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102285568:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970401.740601:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970401.740698:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082306432 00000100:00100000:0.0:1788970401.740705:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082306432 00010000:00010000:0.0:1788970401.740744:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 21 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970401.740780:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 88 00000100:00100000:0.0:1788970401.740789:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:2402:x1875871082306432:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970401.740803:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970401.740809:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 21 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.740833:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 21 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.740858:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f53c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da14 expref: 21 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.740875:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:0.0:1788970401.740880:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.740890:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.740899:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.740926:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970401.740975:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:2402:x1875871082306432:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 185us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970401.740982:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 88 00010000:00010000:2.0:1788970401.741441:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741450:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741494:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741501:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741509:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741515:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.741519:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741528:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741540:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:2.0:1788970401.741543:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788970401.741556:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.741563:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f57b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970401.741632:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+19:12362:x1875871082306304:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 3944us (4118us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788970401.741640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 199 00000100:00100000:2.0:1788970401.744696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970401.744764:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082306560 00000100:00100000:0.0:1788970401.744776:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082306560 00000100:00100000:0.0:1788970401.744835:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:0.0:1788970401.744844:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082306560:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788970401.744892:0:10104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.744933:0:10104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.744943:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788970401.744948:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970401.744952:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.744987:0:10104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.745009:0:10104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 8 pid: 8689 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970401.745024:0:10104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10104:1875871102285696:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970401.745103:0:10104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970401.749052:0:10104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10104:1875871102285696:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970401.749084:0:10104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970401.759615:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.759733:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082306688 00000100:00100000:2.0:1788970401.759742:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082306688 00010000:00010000:2.0:1788970401.759782:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 9 pid: 8689 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970401.759821:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 89 00000100:00100000:2.0:1788970401.759831:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082306688:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970401.759845:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970401.759871:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 9 pid: 8689 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.759885:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 9 pid: 8689 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.759909:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceee7e3d/0xc3abfebe76c6f566 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da30 expref: 9 pid: 8689 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.759924:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970401.759935:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970401.759941:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.759951:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.759986:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970401.760041:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082306688:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 211us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970401.760048:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 89 00010000:00010000:1.0:1788970401.760667:0:10104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760680:0:10104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760702:0:10104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760723:0:10104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760738:0:10104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760746:0:10104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970401.760750:0:10104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760760:0:10104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760773:0:10104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.760781:0:10104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6f582 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970401.760834:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082306560:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 15990us (16151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970401.760843:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:3.0:1788970401.768913:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970401.768987:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082306944 00000100:00100000:1.0:1788970401.768997:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082306944 00000100:00100000:1.0:1788970401.769243:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 200 00000100:00100000:1.0:1788970401.769261:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+19:12362:x1875871082306944:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788970401.769338:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.769356:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.769365:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.769430:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970401.769444:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 19 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970401.769458:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102285824:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970401.769548:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970401.772884:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.773047:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082307072 00000100:00100000:3.0:1788970401.773058:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082307072 00010000:00010000:3.0:1788970401.773110:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 20 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.773154:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 90 00000100:00100000:3.0:1788970401.773167:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+20:2402:x1875871082307072:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970401.773184:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970401.773191:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 20 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.773213:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 20 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.773233:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970401.773241:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.773252:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.773260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.773279:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970401.773336:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+20:2402:x1875871082307072:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 171us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.773344:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 90 00010000:00010000:2.0:1788970401.773826:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f3d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9b9 expref: 19 pid: 6524 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970401.773841:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102285824:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970401.773860:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.773869:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.773874:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.774050:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.774062:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.774086:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.774127:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.774141:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 19 pid: 10102 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970401.774153:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102285952:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970401.774221:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e888d5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970401.777895:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102285952:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970401.777924:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970401.778009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970401.778548:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082307200 00000100:00100000:3.0:1788970401.778569:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082307200 00010000:00010000:3.0:1788970401.778605:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 20 pid: 10102 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.778646:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 91 00000100:00100000:3.0:1788970401.778656:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+20:2402:x1875871082307200:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970401.778671:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970401.778678:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 20 pid: 10102 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.778690:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 20 pid: 10102 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.778713:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f54a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da1b expref: 20 pid: 10102 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.778730:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:3.0:1788970401.778735:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.778745:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.778802:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.778829:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970401.778880:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.778888:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.778928:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+19:2402:x1875871082307200:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 272us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.778945:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 91 00000001:00080000:2.0:1788970401.778997:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788970401.779123:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788970401.779162:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788970401.779249:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102286080:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788970401.779302:0:13652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970401.779342:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970401.779430:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102286080 00000100:00100000:3.0:1788970401.779436:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102286080 00000100:00100000:3.0:1788970401.779478:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788970401.779486:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13652:x1875871102286080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788970401.779564:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13652:x1875871102286080:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.779570:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788970401.779666:0:13652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788970401.779672:0:13652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e4cf00, transno 4294967316 00000100:00100000:0.0:1788970401.779691:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102286080:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788970401.779800:0:13652:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788970401.779843:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102286208:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788970401.779874:0:13652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970401.779895:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970401.779941:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102286208 00000100:00100000:2.0:1788970401.779946:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102286208 00000100:00100000:2.0:1788970401.779981:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788970401.779989:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13652:x1875871102286208:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788970401.780769:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13652:x1875871102286208:12345-0@lo:1000:mdt00_004.0 Request processed in 777us (890us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788970401.780777:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788970401.782060:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13652:1875871102286208:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788970401.782261:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782272:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782279:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782285:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970401.782289:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782297:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782311:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:0.0:1788970401.782314:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970401.782318:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782325:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f590 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782347:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782352:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782357:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782370:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970401.782373:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782474:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782485:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:0.0:1788970401.782488:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970401.782491:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782496:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f4c5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782524:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782539:0:13652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782548:0:13652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782588:0:13652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.782604:0:13652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 22 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970401.782631:0:13652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102286336:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970401.785690:0:13652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970401.790439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.790581:0:13652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13652:1875871102286336:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970401.790606:0:13652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.791514:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082307328 00000100:00100000:3.0:1788970401.791526:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082307328 00010000:00010000:3.0:1788970401.791567:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 23 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970401.791603:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 92 00000100:00100000:3.0:1788970401.791612:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+23:2403:x1875871082307328:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970401.791626:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970401.791632:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 23 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.791644:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 23 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.791665:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f4e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d9ff expref: 23 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.791684:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:3.0:1788970401.791702:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.791712:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.791719:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970401.791772:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970401.791823:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+22:2403:x1875871082307328:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 212us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970401.791832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 92 00010000:00010000:2.0:1788970401.793652:0:13652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793668:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793684:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793690:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793697:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793702:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.793706:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793713:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793745:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.793755:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970401.793762:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793769:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f597 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793784:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793791:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793797:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793803:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970401.793806:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793812:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793820:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7eb55b5700) 00010000:00010000:2.0:1788970401.793822:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970401.793825:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.793831:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f589 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970401.794132:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970401.794138:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788970401.794614:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12362:x1875871082306944:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 25349us (25702us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788970401.794626:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 200 00000020:00080000:2.0:1788970401.794632:0:13652:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788970401.794761:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788970401.794770:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970401.801860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970401.801918:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082307584 00000100:00100000:2.0:1788970401.801929:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082307584 00000100:00100000:2.0:1788970401.801985:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:2.0:1788970401.802006:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12362:x1875871082307584:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788970401.802441:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788970401.802477:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788970401.802512:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.802530:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.802542:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.802551:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.802557:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.802564:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970401.802582:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788970401.802689:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+23:12362:x1875871082307584:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 684us (836us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788970401.802697:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000020:00080000:2.0:1788970401.802702:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788970401.802958:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970401.802966:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.802973:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970401.802977:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.802986:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.803067:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:0.0:1788970401.803070:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788970401.803075:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.803081:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f59e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970401.803094:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970401.803096:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970401.803098:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970401.820641:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970401.885500:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788970401.974129:0:14664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970401.974138:0:14664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970401.974162:0:14664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788970401.974168:0:14664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970402.075301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.075374:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082307840 00000100:00100000:2.0:1788970402.075415:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082307840 00000100:00100000:2.0:1788970402.075468:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:2.0:1788970402.075477:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+23:12373:x1875871082307840:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970402.075500:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970402.075519:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da37 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.075634:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f5ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.075650:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f5ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.075662:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f5ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970402.075674:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788970402.075786:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da37 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.075804:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f5ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da37 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.075819:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970402.075823:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970402.075826:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98a00, rc 0) 00000100:00100000:2.0:1788970402.075881:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+25:12373:x1875871082307840:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 405us (590us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788970402.075888:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 201 00000100:00100000:1.0:1788970402.084531:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.086295:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082307968 00000100:00100000:2.0:1788970402.086308:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082307968 00000100:00100000:2.0:1788970402.086417:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:2.0:1788970402.086429:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+25:12373:x1875871082307968:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:2.0:1788970402.086511:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086530:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086541:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086563:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086574:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086581:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086672:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086681:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086688:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970402.086736:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086749:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086756:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086763:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086770:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970402.086774:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086795:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086808:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970402.086811:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970402.086816:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086829:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f5ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086841:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086847:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086852:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086857:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970402.086860:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086865:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086872:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7e88bd6f00) 00010000:00010000:2.0:1788970402.086874:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970402.086877:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086882:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f5c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086895:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086900:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086914:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086919:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970402.086921:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086927:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086935:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7e88bd6200) 00010000:00010000:2.0:1788970402.086938:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970402.086941:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.086946:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970402.087021:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+25:12373:x1875871082307968:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 593us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.087029:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 202 00000100:00100000:1.0:1788970402.169574:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970402.169710:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082308224 00000100:00100000:0.0:1788970402.169721:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082308224 00000100:00100000:0.0:1788970402.170039:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:0.0:1788970402.170052:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+25:12376:x1875871082308224:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970402.170075:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970402.170098:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f5cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da3e expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170174:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170190:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170213:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170228:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170235:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170241:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170367:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170376:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170430:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970402.170441:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788970402.170524:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170532:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170538:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170544:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970402.170548:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170555:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170566:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970402.170569:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970402.170575:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170581:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f5d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170593:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170598:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170609:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170614:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970402.170617:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170623:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170631:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7d83360e00) 00010000:00010000:0.0:1788970402.170633:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970402.170636:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170641:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012800/0xc3abfebe76c6f5dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170689:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012400/0xc3abfebe76c6f5cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 28 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170703:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 27 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.170710:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:0.0:1788970402.170712:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970402.170715:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012600, rc 0) 00000100:00100000:0.0:1788970402.170785:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12376:x1875871082308224:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 735us (1219us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788970402.170802:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 203 00000100:00100000:0.0:1788970402.178324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.178791:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082308352 00000100:00100000:3.0:1788970402.178800:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082308352 00000100:00100000:3.0:1788970402.178860:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 204 00000100:00100000:3.0:1788970402.178871:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12376:x1875871082308352:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:3.0:1788970402.179829:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179848:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179861:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179901:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179909:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179930:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179937:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.179941:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179949:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179961:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:3.0:1788970402.179965:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970402.179970:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.179976:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f5f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.180054:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12376:x1875871082308352:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 1183us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970402.180063:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 204 00000100:00100000:3.0:1788970402.183915:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.184266:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082308608 00000100:00100000:2.0:1788970402.184276:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082308608 00000100:00100000:2.0:1788970402.184465:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1788970402.184477:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12376:x1875871082308608:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970402.184722:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+28:12376:x1875871082308608:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 246us (817us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788970402.185582:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:0.0:1788970402.213701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.213902:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082308864 00000100:00100000:2.0:1788970402.213912:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082308864 00000100:00100000:2.0:1788970402.213971:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 205 00000100:00100000:2.0:1788970402.213983:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+28:11908:x1875871082308864:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970402.214008:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970402.214036:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da45 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.214146:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.214157:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 29 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.214164:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.214210:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 29 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.214222:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 29 pid: 13652 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970402.214236:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e89a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102286464:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970402.214342:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970402.217174:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e89a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102286464:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970402.217209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00010000:00010000:2.0:1788970402.217220:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.217301:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082308992 00000100:00100000:3.0:1788970402.217308:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082308992 00010000:00010000:3.0:1788970402.217342:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 30 pid: 13652 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.217447:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 93 00000100:00100000:3.0:1788970402.217456:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+30:2403:x1875871082308992:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970402.217477:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970402.217484:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 30 pid: 13652 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.217496:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 30 pid: 13652 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.217517:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f5e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da3e expref: 30 pid: 13652 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.217534:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:3.0:1788970402.217538:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.217548:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.217555:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.217583:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970402.217603:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.217609:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.217624:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+29:2403:x1875871082308992:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 170us (416us total) trans 0 rc 0/0 00000004:00200000:2.0:1788970402.217626:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:3.0:1788970402.217631:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 93 00010000:00010000:2.0:1788970402.218095:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f5f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.218112:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.218120:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:2.0:1788970402.218123:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970402.218125:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98800, rc 0) 00000100:00100000:2.0:1788970402.218696:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+29:11908:x1875871082308864:12345-192.168.203.15@tcp:101:bash.0 Request processed in 4713us (5003us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788970402.218705:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 205 00000100:00100000:0.0:1788970402.221663:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.221753:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082309120 00000100:00100000:1.0:1788970402.221765:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082309120 00000100:00100000:1.0:1788970402.221824:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 206 00000100:00100000:1.0:1788970402.221835:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+29:11908:x1875871082309120:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970402.221881:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.221908:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f60e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da4c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.221943:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f615 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.221963:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f615 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.221977:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f615 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.222088:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f60e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da4c expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.222107:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f615 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da4c expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.222115:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.222118:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970402.222122:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3c00, rc 0) 00000100:00100000:1.0:1788970402.222371:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11908:x1875871082309120:12345-192.168.203.15@tcp:101:bash.0 Request processed in 537us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.222410:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 206 00000100:00100000:3.0:1788970402.230539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.231043:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082309376 00000100:00100000:1.0:1788970402.231052:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082309376 00000100:00100000:1.0:1788970402.231104:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 207 00000100:00100000:1.0:1788970402.231114:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+30:11908:x1875871082309376:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:1.0:1788970402.231563:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.231580:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.231592:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970402.231737:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788970402.231764:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6e85918 reply state 00000000eca64ca1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.231778:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.231785:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.231789:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970402.231793:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788970402.231833:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788970402.231931:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+34:11908:x1875871082309376:12345-192.168.203.15@tcp:36:bash.0 Request processed in 818us (1402us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788970402.231939:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 207 00000020:00080000:1.0:1788970402.231944:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788970402.238467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.238574:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082309504 00000100:00100000:2.0:1788970402.238585:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082309504 00000100:00100000:2.0:1788970402.238683:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 208 00000100:00100000:2.0:1788970402.238695:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+34:11908:x1875871082309504:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970402.238722:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970402.238744:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f623 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da53 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.238818:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f623 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da53 expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.238833:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f623 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da53 expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.238850:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:2.0:1788970402.238854:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970402.238858:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99800, rc 0) 00000100:00100000:2.0:1788970402.238919:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+35:11908:x1875871082309504:12345-192.168.203.15@tcp:101:bash.0 Request processed in 226us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.238926:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 208 00000100:00100000:0.0:1788970402.241143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.241244:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082309632 00000100:00100000:1.0:1788970402.241253:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082309632 00000100:00100000:1.0:1788970402.241436:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1788970402.241446:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+7:11908:x1875871082309632:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970402.241462:0:8689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.241481:0:8689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da5a expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970402.241518:0:8689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa185a0, atime: 0x6aa1859f, ctime: 0x6aa185a0, blocks: 0x8 00010000:00010000:1.0:1788970402.241539:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788970402.241544:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970402.241552:0:8689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.241567:0:8689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 8 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.241579:0:8689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2000, rc 0) 00000100:00080000:0.0:1788970402.241634:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970402.241699:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:11908:x1875871082309632:12345-192.168.203.15@tcp:101:bash.0 Request processed in 254us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.241706:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:3.0:1788970402.243329:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970402.243409:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082309760 00000100:00100000:0.0:1788970402.243417:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082309760 00002000:00010000:0.0:1788970402.243451:0:8447:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788970402.243456:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d8356b0c0 with x1875871082309760 ext(0->18446744073709551615) 00002000:00010000:0.0:1788970402.243466:0:8447:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d8356b0c0. 00000100:00100000:0.0:1788970402.243549:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1788970402.243707:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082309760:12345-192.168.203.15@tcp:10:bash.0 00002000:00010000:1.0:1788970402.243983:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788970402.243987:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788970400 -> 1788970402 00002000:00010000:1.0:1788970402.243990:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788970399 -> 1788970399 00002000:00010000:1.0:1788970402.243992:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788970400 -> 1788970402 00002000:00010000:1.0:1788970402.243994:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788970402.244048:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082309760:12345-192.168.203.15@tcp:10:bash.0 Request processed in 490us (724us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788970402.244056:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00002000:00010000:1.0:1788970402.244060:0:8447:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788970402.244073:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d8356b0c0 with x1875871082309760 ext(0->18446744073709551615) 00002000:00010000:1.0:1788970402.244078:0:8447:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d8356b0c0. 00000100:00100000:0.0:1788970402.337650:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.337721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082309888 00000100:00100000:1.0:1788970402.337843:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082309888 00000100:00100000:1.0:1788970402.337950:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 209 00000100:00100000:1.0:1788970402.337962:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+35:12390:x1875871082309888:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:1.0:1788970402.338035:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338052:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338064:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338079:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338086:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338092:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338171:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338181:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338189:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970402.338278:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338290:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338296:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338312:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338319:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.338323:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338330:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338343:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970402.338346:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.338351:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338358:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f631 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338372:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338378:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338601:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338606:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.338610:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338623:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338633:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:1.0:1788970402.338635:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.338639:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338645:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338659:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338665:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338670:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338675:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.338678:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338694:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338702:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.338704:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.338708:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.338713:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f63f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.338899:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+35:12390:x1875871082309888:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 938us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.338908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 209 00000100:00100000:0.0:1788970402.384589:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.385064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082310144 00000100:00100000:1.0:1788970402.385075:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082310144 00000100:00100000:1.0:1788970402.385417:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00100000:1.0:1788970402.385441:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+35:12393:x1875871082310144:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970402.385462:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.385486:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385565:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385580:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385592:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385618:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385626:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385632:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385880:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385890:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385898:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970402.385908:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788970402.385983:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385990:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.385996:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386001:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.386006:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386024:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386036:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970402.386039:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.386043:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386050:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f64d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386063:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386069:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386075:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386080:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.386082:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386099:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386108:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:1.0:1788970402.386111:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.386115:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386132:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386183:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da61 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386207:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f65b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da61 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.386214:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.386217:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788970402.386219:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2e00, rc 0) 00000100:00100000:1.0:1788970402.386289:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12393:x1875871082310144:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 851us (1709us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788970402.386296:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 210 00000100:00100000:2.0:1788970402.390864:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.390964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082310272 00000100:00100000:3.0:1788970402.390975:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082310272 00000100:00100000:3.0:1788970402.391064:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 211 00000100:00100000:3.0:1788970402.391087:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12393:x1875871082310272:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:3.0:1788970402.391150:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.391167:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.391177:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.391233:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.391247:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 37 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.391260:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102286592:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970402.391557:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970402.397706:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.397815:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875871102286592:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970402.397844:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.397896:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082310528 00000100:00100000:1.0:1788970402.397905:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082310528 00000100:00100000:1.0:1788970402.398011:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:1.0:1788970402.398022:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+38:6171:x1875871082310528:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788970402.398345:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+39:6171:x1875871082310528:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 325us (648us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788970402.398353:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:3.0:1788970402.400639:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970402.400749:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082310656 00000100:00100000:0.0:1788970402.400759:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082310656 00010000:00010000:0.0:1788970402.400799:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 39 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970402.400840:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 94 00000100:00100000:0.0:1788970402.400850:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+39:2402:x1875871082310656:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970402.400865:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970402.400873:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 39 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.400908:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 39 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.400930:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f600 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da45 expref: 39 pid: 6526 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.400947:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:0.0:1788970402.400952:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.400961:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.400968:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.400995:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970402.401042:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+38:2402:x1875871082310656:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 194us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970402.401050:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 94 00010000:00010000:0.0:1788970402.401165:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401174:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401229:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401246:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401252:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401258:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970402.401263:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401270:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401279:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:0.0:1788970402.401281:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970402.401285:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.401290:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970402.401344:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12393:x1875871082310272:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 10259us (10488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970402.401357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 211 00000100:00100000:3.0:1788970402.405255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.405492:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082310912 00000100:00100000:2.0:1788970402.405503:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082310912 00000100:00100000:2.0:1788970402.405564:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:2.0:1788970402.405574:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+37:12393:x1875871082310912:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970402.405814:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+38:12393:x1875871082310912:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 241us (570us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788970402.405823:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:0.0:1788970402.510006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.510879:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082311168 00000100:00100000:1.0:1788970402.510894:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082311168 00000100:00100000:1.0:1788970402.511375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 212 00000100:00100000:1.0:1788970402.511413:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+38:12404:x1875871082311168:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1788970402.511468:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.511496:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f670 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da68 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511593:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511611:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511625:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511644:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511652:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511659:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511884:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f685 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511896:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.511904:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970402.511916:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788970402.512035:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.512042:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.512049:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.512056:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.512061:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.512069:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.512085:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970402.513805:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.513823:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513835:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f677 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513865:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513873:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513880:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513887:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.513914:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513924:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513943:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:1.0:1788970402.513946:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.513949:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.513956:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f67e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.514038:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f670 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da68 expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.514055:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da68 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.514062:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.514065:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970402.514068:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3200, rc 0) 00000100:00100000:1.0:1788970402.514657:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+40:12404:x1875871082311168:12345-192.168.203.15@tcp:101:cat.0 Request processed in 3244us (4661us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788970402.514669:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 212 00000100:00100000:0.0:1788970402.520573:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.520691:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082311424 00000100:00100000:2.0:1788970402.520704:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082311424 00000100:00100000:2.0:1788970402.520787:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:2.0:1788970402.520800:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+40:12404:x1875871082311424:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:2.0:1788970402.521361:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+41:12404:x1875871082311424:12345-192.168.203.15@tcp:35:cat.0 Request processed in 561us (800us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788970402.521435:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:3.0:1788970402.542524:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.542651:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082311680 00000100:00100000:1.0:1788970402.542666:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082311680 00000100:00100000:1.0:1788970402.542751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 213 00000100:00100000:1.0:1788970402.542764:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+41:12405:x1875871082311680:12345-192.168.203.15@tcp:36:rm.0 00010000:00010000:1.0:1788970402.542883:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788970402.542923:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f623 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da53 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.542951:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da68 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.542966:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f65b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da61 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.542977:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f615 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da4c expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.542988:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.542995:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970402.543025:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543043:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543055:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543074:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543082:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543114:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543237:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543247:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543255:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970402.543601:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:1.0:1788970402.543665:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543675:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543684:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543692:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543699:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543706:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543738:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970402.543775:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543783:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543790:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543796:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.543802:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543809:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543819:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:1.0:1788970402.543823:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788970402.543828:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543834:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c6f6a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543852:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543858:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543864:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543869:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.543879:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543886:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543894:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970402.543897:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970402.543900:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543906:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f693 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970402.543917:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c51ef693 reply state 000000001315ad6e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543930:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.543937:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:1.0:1788970402.543939:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970402.543942:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970402.544060:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+39:12405:x1875871082311680:12345-192.168.203.15@tcp:36:rm.0 Request processed in 1292us (1544us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788970402.544070:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 213 00010000:00010000:3.0:1788970402.544357:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970402.544366:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.544411:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970402.544414:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.544422:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.544432:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:3.0:1788970402.544435:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788970402.544438:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.544444:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3800/0xc3abfebe76c6f6a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.544455:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970402.544457:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970402.544458:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970402.585685:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.586170:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082311936 00000100:00100000:3.0:1788970402.586184:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082311936 00000100:00100000:3.0:1788970402.586277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 214 00000100:00100000:3.0:1788970402.586291:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+39:12411:x1875871082311936:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970402.586325:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970402.586353:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f6af lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da6f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.586536:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.586557:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.586592:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.586607:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.586615:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.586622:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788970402.587456:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788970402.587660:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.587673:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.587683:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.587735:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.589565:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970402.589595:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102286720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970402.589692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970402.589941:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102286720 00000100:00100000:2.0:1788970402.589952:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102286720 00000100:00100000:2.0:1788970402.590026:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788970402.590039:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102286720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970402.590086:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970402.590161:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102286720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.590169:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788970402.590243:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102286720:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970402.590844:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.590858:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.590865:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.590888:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.590899:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.591843:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:3.0:1788970402.591851:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970402.591859:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.591869:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c6f6b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970402.591897:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8474f75 reply state 00000000df3b5bc1 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.591967:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.591978:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:3.0:1788970402.591981:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970402.591986:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788970402.592070:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c6f6af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.592089:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.592095:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:3.0:1788970402.592097:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970402.592113:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4400, rc 0) 00000100:00100000:3.0:1788970402.592211:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+42:12411:x1875871082311936:12345-192.168.203.15@tcp:101:bash.0 Request processed in 5922us (6542us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788970402.592221:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 214 00000100:00100000:2.0:1788970402.597873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.598163:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082312064 00000100:00100000:1.0:1788970402.598250:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082312064 00000100:00100000:1.0:1788970402.598442:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:1.0:1788970402.598456:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082312064:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970402.598481:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.598512:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da76 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970402.598549:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970402.598577:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788970402.598583:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970402.598595:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.598620:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.598636:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2600, rc 0) 00000100:00100000:1.0:1788970402.598713:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082312064:12345-192.168.203.15@tcp:101:bash.0 Request processed in 261us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.598721:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00080000:0.0:1788970402.600105:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970402.602802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.603289:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082312192 00000100:00100000:1.0:1788970402.603305:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082312192 00000100:00100000:1.0:1788970402.603572:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:1.0:1788970402.603586:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+8:12411:x1875871082312192:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970402.603904:0:10104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.604057:0:10104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da7d expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.604128:0:10104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.604139:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970402.604144:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970402.604150:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 9 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.605162:0:10104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.605199:0:10104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.605222:0:10104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10104:1875871102286848:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970402.605429:0:10104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970402.608411:0:10104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10104:1875871102286848:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970402.608463:0:10104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 9 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.608490:0:10104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3a00, rc 0) 00000100:00100000:1.0:1788970402.608569:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+9:12411:x1875871082312192:12345-192.168.203.15@tcp:101:bash.0 Request processed in 4986us (5781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.608580:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1788970402.610328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.610564:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082312320 00000100:00100000:1.0:1788970402.610578:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082312320 00010000:00010000:1.0:1788970402.611182:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.611308:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:1.0:1788970402.611323:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2403:x1875871082312320:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970402.611347:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970402.611423:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.611518:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.611553:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6f6d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da76 expref: 9 pid: 8440 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.611577:0:7932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970402.611582:0:7932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970402.611595:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 8 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.611608:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 8 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.611660:0:7932:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 8 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.611708:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7932:1875871102286976:192.168.203.15@tcp:105: 00000100:00100000:1.0:1788970402.611852:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970402.617041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.617468:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7932:1875871102286976:192.168.203.15@tcp:105: 00010000:00010000:1.0:1788970402.617503:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970402.617588:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082312320:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 6268us (7268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.617603:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 95 00000100:00100000:3.0:1788970402.617848:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082312576 00000100:00100000:3.0:1788970402.617859:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082312576 00000100:00100000:3.0:1788970402.617920:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:3.0:1788970402.617932:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+42:12411:x1875871082312576:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1788970402.618330:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12411:x1875871082312576:12345-192.168.203.15@tcp:35:bash.0 Request processed in 399us (1307us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788970402.618338:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:0.0:1788970402.718902:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.719027:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082312704 00000100:00100000:1.0:1788970402.719040:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082312704 00000100:00100000:1.0:1788970402.719125:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 215 00000100:00100000:1.0:1788970402.719139:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+43:12427:x1875871082312704:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970402.719172:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.719206:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f6e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da84 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.719335:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f6e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.719356:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.719371:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970402.719491:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788970402.719497:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970402.719534:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.719568:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2600/0xc3abfebe76c6f6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da84 expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.719589:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da84 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.719597:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970402.719600:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970402.719606:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3c00, rc 0) 00000100:00100000:1.0:1788970402.719680:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+44:12427:x1875871082312704:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 545us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.719686:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 215 00000100:00100000:2.0:1788970402.723148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970402.723439:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082312960 00000100:00100000:0.0:1788970402.723453:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082312960 00000100:00100000:0.0:1788970402.723529:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 216 00000100:00100000:0.0:1788970402.723541:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+44:12427:x1875871082312960:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970402.723568:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970402.723595:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f6ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da8b expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.723741:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f6f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.723759:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.723772:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970402.723785:0:13652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788970402.723928:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013800/0xc3abfebe76c6f6ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da8b expref: 47 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.723954:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da8b expref: 46 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.723963:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:0.0:1788970402.723966:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970402.723970:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012600, rc 0) 00000100:00100000:0.0:1788970402.724485:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+46:12427:x1875871082312960:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 945us (1354us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788970402.724508:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 216 00000100:00100000:0.0:1788970402.727602:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.727761:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082313216 00000100:00100000:3.0:1788970402.727774:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082313216 00000100:00100000:3.0:1788970402.727846:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 217 00000100:00100000:3.0:1788970402.727857:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+46:12427:x1875871082313216:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970402.727891:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970402.727919:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f703 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da92 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.728047:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f70a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.728065:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f70a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.728077:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f70a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970402.728185:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788970402.728352:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f703 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da92 expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.728373:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da92 expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.728536:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:3.0:1788970402.728540:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788970402.728544:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:3.0:1788970402.728800:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+48:12427:x1875871082313216:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 943us (1211us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788970402.728809:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 217 00000100:00100000:0.0:1788970402.730506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.734927:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082313344 00000100:00100000:3.0:1788970402.734949:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082313344 00000100:00100000:3.0:1788970402.735255:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1788970402.735269:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+48:2402:x1875871082313344:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970402.735301:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970402.735337:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012600/0xc3abfebe76c6f6f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da8b expref: 48 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.735365:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:3.0:1788970402.735371:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970402.735624:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+47:2402:x1875871082313344:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 357us (5129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970402.735633:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:1.0:1788970402.736455:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.736604:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082313472 00000100:00100000:2.0:1788970402.736615:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082313472 00000100:00100000:2.0:1788970402.736676:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:2.0:1788970402.736685:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2400:x1875871082313472:12345-192.168.203.15@tcp:1:lfs.0 00010000:00010000:2.0:1788970402.736741:0:8689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.736765:0:8689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 8 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.736775:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788970402.736781:0:8689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970402.736804:0:8689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.736845:0:8689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 8 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.736861:0:8689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 8 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970402.736880:0:8689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8689:1875871102287104:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970402.736982:0:8689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970402.740902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.741014:0:8689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8689:1875871102287104:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970402.741056:0:8689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.741134:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082313600 00000100:00100000:3.0:1788970402.741144:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082313600 00002000:00100000:3.0:1788970402.741243:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a7d83e88780 x1875871082313600/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:178/0 lens 504/0 e 0 to 0 dl 1788970413 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970402.741254:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e88780 with x1875871082313600 ext(0->8) 00010000:00010000:3.0:1788970402.741262:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 9 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.741278:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 9 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970402.741285:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7d83e88780 00000100:00100000:3.0:1788970402.741321:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1788970402.741331:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082313600:12345-192.168.203.15@tcp:4:lfs.0 00000100:00100000:3.0:1788970402.742531:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+11:2402:x1875871082313600:12345-192.168.203.15@tcp:4:lfs.0 Request processed in 1189us (1635us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788970402.742543:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00002000:00100000:3.0:1788970402.742555:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a7d83e88780 x1875871082313600/t4294967309(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:178/0 lens 504/448 e 0 to 0 dl 1788970413 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970402.742565:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e88780 with x1875871082313600 ext(0->8) 00010000:00010000:3.0:1788970402.742573:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 11 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.742590:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 11 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970402.742597:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8a7d83e88780 00000100:00100000:3.0:1788970402.745792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.745938:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082313728 00000100:00100000:2.0:1788970402.745951:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082313728 00010000:00010000:2.0:1788970402.746008:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 11 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970402.746059:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 96 00000100:00100000:2.0:1788970402.746070:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+11:2401:x1875871082313728:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970402.746089:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788970402.746122:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788970402.746125:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788970402 00002000:00010000:2.0:1788970402.746128:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788970402 00002000:00010000:2.0:1788970402.746130:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788970402 00002000:00010000:2.0:1788970402.746133:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788970402.746139:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 11 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.746171:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 11 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.746210:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c6f6d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da7d expref: 11 pid: 10104 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.746229:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970402.746234:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970402.746242:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.746253:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.746293:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970402.746357:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2401:x1875871082313728:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 288us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.746368:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 96 00010000:00010000:3.0:1788970402.746881:0:8689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746895:0:8689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746924:0:8689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746933:0:8689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746941:0:8689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746948:0:8689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970402.746953:0:8689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746964:0:8689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746979:0:8689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.746988:0:8689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066677a68/0xc3abfebe76c6f718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.747074:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2400:x1875871082313472:12345-192.168.203.15@tcp:1:lfs.0 Request processed in 10389us (10624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970402.747083:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:0.0:1788970402.749165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.749308:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082313984 00000100:00100000:3.0:1788970402.749320:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082313984 00000100:00100000:3.0:1788970402.749467:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:3.0:1788970402.749478:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+47:12427:x1875871082313984:12345-192.168.203.15@tcp:35:lfs.0 00000004:00010000:3.0:1788970402.749556:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da92 expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970402.749798:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788970402.749831:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788970402.750321:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1788970402.750367:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.750539:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 51 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.750551:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.750594:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 51 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.750612:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 51 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.750643:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875871102287232:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970402.750819:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d826680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970402.753356:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970402.753555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082314112 00000100:00100000:0.0:1788970402.753568:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082314112 00010000:00010000:0.0:1788970402.753621:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 52 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970402.753683:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 97 00000100:00100000:0.0:1788970402.753695:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+52:2403:x1875871082314112:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970402.753715:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970402.753737:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 52 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.753753:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 52 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.753781:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:0.0:1788970402.753787:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.753797:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.753806:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970402.753854:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970402.753928:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+52:2403:x1875871082314112:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 234us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970402.753937:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 97 00010000:00010000:3.0:1788970402.754557:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c6f6c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da6f expref: 51 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.754579:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875871102287232:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970402.754606:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.754616:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.754622:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970402.754771:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788970402.754894:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788970402.754995:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102287360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788970402.755052:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970402.755175:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102287360 00000100:00100000:2.0:1788970402.755182:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102287360 00000100:00100000:2.0:1788970402.755253:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788970402.755264:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1875871102287360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788970402.755358:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1875871102287360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.755413:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788970402.755578:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970402.755603:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102287360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788970402.755835:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788970402.755895:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102287488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788970402.755928:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970402.755991:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970402.757069:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102287488 00000100:00100000:2.0:1788970402.757081:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102287488 00000100:00100000:2.0:1788970402.757692:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788970402.757704:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6527:x1875871102287488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788970402.758067:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6527:x1875871102287488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 364us (2137us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788970402.758075:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788970402.758269:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875871102287488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788970402.758361:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788970402.758772:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.758788:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.758797:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.758803:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970402.758810:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.758820:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.758838:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:2.0:1788970402.758842:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788970402.758848:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.758855:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f71f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970402.759001:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788970402.759077:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788970402.759159:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422025776540ns, next at 423025773917ns, rc = 0 00000001:00080000:2.0:1788970402.759168:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788970402.759282:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7d823ee500) 00010000:00010000:2.0:1788970402.759286:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788970402.759294:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f70a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da92 expref: 55 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970402.761496:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+54:12427:x1875871082313984:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 12005us (12325us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788970402.761515:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000020:00080000:2.0:1788970402.761525:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788970402.763846:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.763962:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082314240 00000100:00100000:1.0:1788970402.763977:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082314240 00000100:00100000:1.0:1788970402.764103:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 218 00000100:00100000:1.0:1788970402.764116:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+54:12427:x1875871082314240:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970402.764150:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.764202:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f726 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8da99 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.764314:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f726 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da99 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.764332:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f726 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da99 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.764355:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970402.764359:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970402.764364:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2e00, rc 0) 00000100:00100000:1.0:1788970402.764465:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+55:12427:x1875871082314240:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 352us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.764472:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 218 00000100:00100000:0.0:1788970402.767135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.767358:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082314496 00000100:00100000:1.0:1788970402.767372:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082314496 00000100:00100000:1.0:1788970402.767585:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:1.0:1788970402.767597:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+55:12427:x1875871082314496:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:1.0:1788970402.767930:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+56:12427:x1875871082314496:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 335us (808us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788970402.767939:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:2.0:1788970402.837126:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.837258:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082314624 00000100:00100000:3.0:1788970402.837272:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082314624 00000100:00100000:3.0:1788970402.837360:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 219 00000100:00100000:3.0:1788970402.837373:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+56:12437:x1875871082314624:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:3.0:1788970402.837530:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837553:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837569:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837583:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837591:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837598:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837696:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837706:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837715:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970402.837815:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837831:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837837:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837845:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837851:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.837860:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837868:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837881:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:3.0:1788970402.837884:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970402.837891:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837897:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f72d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837913:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837919:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837932:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837938:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.837941:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837948:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837956:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:3.0:1788970402.837958:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970402.837961:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837967:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837978:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837984:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837990:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.837997:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.838000:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.838016:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.838024:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970402.838026:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970402.838029:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.838036:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f73b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.838119:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+56:12437:x1875871082314624:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 748us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970402.838127:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 219 00010000:00010000:0.0:1788970402.845400:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970402.873352:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.873556:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082314880 00000100:00100000:3.0:1788970402.873570:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082314880 00000100:00100000:3.0:1788970402.873653:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:3.0:1788970402.873667:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+56:12440:x1875871082314880:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970402.873695:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970402.873734:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f742 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8daa0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.873832:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.873851:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.873865:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.873900:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.873908:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.873914:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874063:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874071:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874077:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970402.874364:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788970402.874517:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874527:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874535:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874542:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.874547:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874568:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874582:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:3.0:1788970402.874585:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970402.874590:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874596:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f749 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874612:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874617:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874622:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874626:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970402.874628:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874633:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874640:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:3.0:1788970402.874642:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970402.874645:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874660:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f750 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874708:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f742 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874773:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.874782:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970402.874784:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970402.874787:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:3.0:1788970402.874927:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+58:12440:x1875871082314880:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1262us (1590us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788970402.874936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 220 00000100:00100000:0.0:1788970402.878604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.878707:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082315008 00000100:00100000:1.0:1788970402.878720:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082315008 00000100:00100000:1.0:1788970402.878821:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 221 00000100:00100000:1.0:1788970402.878833:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+58:12440:x1875871082315008:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1788970402.878927:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.878971:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.878985:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879033:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879040:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879048:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879054:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970402.879059:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879068:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879080:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970402.879097:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970402.879103:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.879110:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.879225:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+58:12440:x1875871082315008:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 393us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.879240:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 221 00000100:00100000:2.0:1788970402.881918:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.882009:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082315264 00000100:00100000:3.0:1788970402.882024:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082315264 00000100:00100000:3.0:1788970402.882101:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:3.0:1788970402.882113:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+58:12440:x1875871082315264:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970402.882467:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12440:x1875871082315264:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 356us (565us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788970402.882474:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:0.0:1788970402.944827:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.945003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082315520 00000100:00100000:1.0:1788970402.945018:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082315520 00000100:00100000:1.0:1788970402.945105:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 222 00000100:00100000:1.0:1788970402.945117:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12449:x1875871082315520:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970402.945152:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.945155:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788970402.945208:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f6e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da84 expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.945231:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970402.945238:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970402.945255:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f76c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8daa7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.945508:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.945525:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.945534:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.945576:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.945590:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 59 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.945622:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102287616:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970402.947069:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970402.949016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970402.949428:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082315648 00000100:00100000:2.0:1788970402.949440:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082315648 00010000:00010000:2.0:1788970402.949496:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 60 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970402.949548:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 98 00000100:00100000:2.0:1788970402.949560:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+60:2403:x1875871082315648:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970402.949578:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970402.949586:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 60 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.949626:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 60 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.949656:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970402.949663:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.949674:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.949683:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.949706:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970402.949861:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+60:2403:x1875871082315648:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 302us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.949871:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 98 00010000:00010000:1.0:1788970402.951717:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f757 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa0 expref: 59 pid: 6526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.951827:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102287616:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970402.951863:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.951876:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.951882:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970402.951909:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788970402.952153:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f76c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.952241:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.952254:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970402.952259:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788970402.952263:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2200, rc 0) 00000100:00100000:1.0:1788970402.952564:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12449:x1875871082315520:12345-192.168.203.15@tcp:101:bash.0 Request processed in 7447us (7751us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788970402.952597:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 222 00000100:00100000:0.0:1788970402.956884:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.957003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082315776 00000100:00100000:3.0:1788970402.957017:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082315776 00000100:00100000:2.0:1788970402.957256:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 223 00000100:00100000:2.0:1788970402.957276:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+59:12449:x1875871082315776:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970402.957310:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970402.957338:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f781 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8daae expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.957519:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.957538:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.957573:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.957885:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f781 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 61 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.957914:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 60 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970402.957927:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970402.957931:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970402.957938:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98c00, rc 0) 00000100:00100000:2.0:1788970402.958105:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+60:12449:x1875871082315776:12345-192.168.203.15@tcp:101:bash.0 Request processed in 836us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970402.958114:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 223 00000100:00100000:2.0:1788970402.964830:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.964953:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316032 00000100:00100000:1.0:1788970402.964967:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316032 00000100:00100000:1.0:1788970402.965084:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 224 00000100:00100000:1.0:1788970402.965167:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+60:12449:x1875871082316032:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:1.0:1788970402.965690:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.965808:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.965823:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970402.965877:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788970402.965902:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e81400f reply state 00000000847ee55c transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.965917:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.965926:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970402.965929:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788970402.965934:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970402.966093:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12449:x1875871082316032:12345-192.168.203.15@tcp:36:bash.0 Request processed in 922us (1268us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788970402.966102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 224 00000020:00080000:1.0:1788970402.966107:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788970402.968594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970402.968706:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316160 00000100:00100000:1.0:1788970402.968738:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316160 00000100:00100000:1.0:1788970402.968838:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 225 00000100:00100000:1.0:1788970402.968850:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12449:x1875871082316160:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970402.968880:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970402.968905:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f796 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dab5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.969012:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.969029:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.969040:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.969153:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.969286:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 64 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.969304:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102287744:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970402.969494:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970402.972900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.972974:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316288 00000100:00100000:3.0:1788970402.972987:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316288 00010000:00010000:3.0:1788970402.973058:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 65 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970402.973116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 99 00000100:00100000:3.0:1788970402.973127:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+65:2403:x1875871082316288:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970402.973145:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970402.973153:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 65 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.973413:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 65 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.973442:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970402.973449:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.973461:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.973471:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970402.973496:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970402.973557:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+65:2403:x1875871082316288:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 431us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970402.973566:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 99 00010000:00010000:1.0:1788970402.975400:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f773 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daa7 expref: 64 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970402.975431:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102287744:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970402.975488:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.975500:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.975506:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970402.975580:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788970402.975586:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970402.975613:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.975654:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c6f796 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.975670:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970402.975681:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970402.975684:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970402.975688:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3600, rc 0) 00000100:00100000:1.0:1788970402.975876:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12449:x1875871082316160:12345-192.168.203.15@tcp:101:bash.0 Request processed in 7027us (7293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970402.975887:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 225 00000100:00100000:0.0:1788970402.978910:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970402.979025:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316544 00000100:00100000:3.0:1788970402.979041:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316544 00000100:00100000:3.0:1788970402.979339:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:3.0:1788970402.979373:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+63:12449:x1875871082316544:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1788970402.979750:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12449:x1875871082316544:12345-192.168.203.15@tcp:35:bash.0 Request processed in 380us (853us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788970402.979758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1788970403.037302:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.037467:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316672 00000100:00100000:3.0:1788970403.037480:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316672 00000100:00100000:3.0:1788970403.037644:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 226 00000100:00100000:3.0:1788970403.037657:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+64:12456:x1875871082316672:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970403.037688:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970403.037715:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dabc expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.037945:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f7ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.037963:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.037977:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970403.038031:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788970403.038035:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970403.038055:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.038149:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dabc expref: 66 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.038260:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f7ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dabc expref: 65 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.038270:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:3.0:1788970403.038274:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970403.038278:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654a00, rc 0) 00000100:00100000:3.0:1788970403.038446:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12456:x1875871082316672:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 791us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.038454:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 226 00000100:00080000:0.0:1788970403.038512:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970403.046715:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970403.046818:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316800 00000100:00100000:1.0:1788970403.046833:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316800 00000100:00100000:1.0:1788970403.046907:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 227 00000100:00100000:1.0:1788970403.046920:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12456:x1875871082316800:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970403.046966:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970403.046999:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f7b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dac3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047089:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047109:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047124:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047137:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047145:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047151:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047255:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047264:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047271:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970403.047430:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788970403.047441:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970403.047469:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047486:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047497:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047505:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047513:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047519:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970403.047524:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047533:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047546:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:1.0:1788970403.047555:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970403.047562:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047569:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3400/0xc3abfebe76c6f7b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047584:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047602:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047608:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047613:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970403.047616:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047627:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047636:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:1.0:1788970403.047638:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970403.047641:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047647:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c6f7c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047681:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2200/0xc3abfebe76c6f7b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047696:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.047705:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970403.047707:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970403.047718:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2c00, rc 0) 00000100:00100000:1.0:1788970403.047996:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12456:x1875871082316800:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1077us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970403.048005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 227 00000100:00100000:1.0:1788970403.061642:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970403.061734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.061824:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082317184 00000100:00100000:3.0:1788970403.061836:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082317184 00000100:00100000:3.0:1788970403.061912:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 228 00000100:00100000:3.0:1788970403.061924:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12456:x1875871082317184:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970403.061951:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970403.061977:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f7ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8daca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.062136:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.062154:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.062164:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.062214:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.062261:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.062277:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 67 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970403.062302:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102287872:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970403.063450:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082316928 00000100:00100000:2.0:1788970403.063462:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082316928 00010000:00010000:2.0:1788970403.063514:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 68 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.063607:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 100 00000100:00100000:2.0:1788970403.063619:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+68:2403:x1875871082316928:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970403.063634:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970403.063642:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 68 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.063669:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 68 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.063695:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970403.063700:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.063709:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.063715:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970403.063797:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+68:2403:x1875871082316928:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 181us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.063805:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 100 00010000:00010000:1.0:1788970403.064524:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.064540:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 67 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970403.064556:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102288000:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970403.064588:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668480 going to sleep for 11 seconds 00000100:00100000:1.0:1788970403.068140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970403.071544:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082317312 00000100:00100000:0.0:1788970403.071568:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082317312 00010000:00010000:0.0:1788970403.071645:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 68 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970403.071711:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 101 00000100:00100000:0.0:1788970403.071722:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+68:2402:x1875871082317312:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970403.071744:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970403.071753:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 68 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970403.071794:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 68 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970403.071824:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:0.0:1788970403.071832:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970403.071845:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970403.071856:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970403.071897:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970403.072001:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+68:2402:x1875871082317312:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 280us (3879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.072010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 101 00010000:00010000:2.0:1788970403.075370:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c6f79d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dab5 expref: 67 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.075425:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102288000:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970403.075449:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.15@tcp) returned -22 from blocking AST (req@00000000c80709f7 x1875871102287872) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 66 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.075468:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c6f7c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dac3 expref: 66 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.075477:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875871102287872:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970403.075542:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970403.075558:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.075570:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.075576:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970403.075605:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788970403.075808:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c6f7ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.075825:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.075834:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970403.075837:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970403.075839:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:2.0:1788970403.077551:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12456:x1875871082317184:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 15614us (15800us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788970403.077568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 228 00000100:00100000:1.0:1788970403.080442:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.080716:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082317568 00000100:00100000:3.0:1788970403.080727:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082317568 00000100:00100000:3.0:1788970403.080839:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1788970403.080851:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12456:x1875871082317568:12345-192.168.203.15@tcp:103:lfs.0 00010000:00010000:3.0:1788970403.080867:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970403.080893:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2e00/0xc3abfebe76c6f726 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da99 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.080913:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970403.080918:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970403.080976:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12456:x1875871082317568:12345-192.168.203.15@tcp:103:lfs.0 Request processed in 128us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.080984:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1788970403.084339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.084488:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082317696 00000100:00100000:2.0:1788970403.084499:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082317696 00000100:00100000:2.0:1788970403.084554:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 229 00000100:00100000:2.0:1788970403.084564:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12456:x1875871082317696:12345-192.168.203.15@tcp:58:lfs.0 00010000:00010000:2.0:1788970403.084676:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.084705:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.084719:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970403.085357:0:10102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788970403.085973:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12456:x1875871082317696:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 1406us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.085984:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 229 00000100:00100000:1.0:1788970403.088812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.088913:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082317824 00000100:00100000:2.0:1788970403.088922:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082317824 00000100:00100000:2.0:1788970403.088982:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:2.0:1788970403.088992:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+65:12456:x1875871082317824:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970403.089014:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970403.089037:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dad1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.089108:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.089119:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.089137:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.089151:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.089180:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970403.089183:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970403.089198:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.089207:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98800, rc 0) 00000100:00100000:2.0:1788970403.089271:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12456:x1875871082317824:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 281us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.089279:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 230 00000100:00100000:1.0:1788970403.612685:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d845183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102288128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970403.612788:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970403.612872:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970403.612881:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102288256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970403.612909:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970403.612957:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288128 00000100:00100000:1.0:1788970403.612968:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288128 00000100:00100000:1.0:1788970403.613033:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288256 00000100:00100000:1.0:1788970403.613038:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288256 00000100:00100000:1.0:1788970403.613059:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788970403.613068:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102288128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970403.613103:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970403.613147:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102288128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970403.613155:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788970403.613162:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102288384:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613175:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788970403.613192:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3651:x1875871102288256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970403.613207:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970403.613241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970403.613247:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3651:x1875871102288256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970403.613255:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788970403.613280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102288896:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613299:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288384 00000100:00100000:1.0:1788970403.613304:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288384 00000100:00100000:3.0:1788970403.613311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613333:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613334:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788970403.613345:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102288384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970403.613427:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102288384:12345-0@lo:400:kworker.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970403.613434:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788970403.613448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102288384:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613465:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788970403.613470:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102288512:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613489:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613500:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102289024:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613512:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613521:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102289536:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613532:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613552:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102289408 00000100:00100000:3.0:1788970403.613556:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102289408 00000100:00100000:3.0:1788970403.613583:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788970403.613590:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613625:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102289408:12345-0@lo:400:kworker.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.613630:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788970403.613644:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102288768:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613660:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613669:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102289280:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613680:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102288640:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613682:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970403.613717:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613728:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613742:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102289152:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288512 00000100:00100000:3.0:1788970403.613750:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288512 00000100:00100000:3.0:1788970403.613771:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102289024 00000100:00100000:3.0:1788970403.613773:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102289024 00000100:00100000:3.0:1788970403.613781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102289536 00000100:00100000:3.0:1788970403.613782:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102289536 00000100:00100000:3.0:1788970403.613790:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288768 00000100:00100000:3.0:1788970403.613791:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288768 00000100:00100000:3.0:1788970403.613798:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788970403.613802:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102288512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613825:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102288512:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.613829:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788970403.613842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102288512:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613852:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788970403.613856:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102289024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613869:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613875:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102289024:12345-0@lo:400:kworker.0 Request processed in 18us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.613883:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788970403.613895:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102289664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.613911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613925:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970403.613930:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102289152 00000100:00100000:3.0:1788970403.613935:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102289152 00000100:00100000:3.0:1788970403.613954:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102289664 00000100:00100000:1.0:1788970403.613958:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102288256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970403.613959:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102289664 00000100:00100000:3.0:1788970403.613979:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788970403.613984:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102289536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.613993:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d845183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102288128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970403.614029:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102289280 00000100:00100000:1.0:1788970403.614033:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102289280 00000100:00100000:1.0:1788970403.614061:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788970403.614069:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102289280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.614106:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102289280:12345-0@lo:400:kworker.0 Request processed in 39us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970403.614112:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788970403.614138:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102289280:0@lo:400:kworker.0 00000100:00080000:0.0:1788970403.614216:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970403.614222:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970403.614224:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970403.614227:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970403.614241:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288896 00000100:00100000:0.0:1788970403.614245:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288896 00000100:00100000:0.0:1788970403.614269:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102288640 00000100:00100000:0.0:1788970403.614271:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102288640 00000100:00100000:0.0:1788970403.614282:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788970403.614288:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102288896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970403.614329:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102288896:12345-0@lo:400:kworker.0 Request processed in 41us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.614342:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788970403.614356:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788970403.614362:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102288640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970403.614413:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102288640:12345-0@lo:400:kworker.0 Request processed in 51us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.614419:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788970403.614437:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788970403.614443:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102288768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970403.614471:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102288768:12345-0@lo:400:kworker.0 Request processed in 29us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.614477:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788970403.614489:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788970403.614495:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102289152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970403.614520:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102289152:12345-0@lo:400:kworker.0 Request processed in 25us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.614525:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788970403.614536:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788970403.614541:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970403.614568:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102289664:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.614573:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788970403.614598:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102288896:0@lo:400:kworker.0 00000100:00100000:0.0:1788970403.614618:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102288640:0@lo:400:kworker.0 00010000:00080000:0.0:1788970403.614629:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ddfc00 x1875871102289152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970403.614644:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102289152:0@lo:400:kworker.0 00010000:00080000:0.0:1788970403.614655:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ddcb40 x1875871102289664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970403.614662:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788970403.615228:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102288768:0@lo:400:kworker.0 00000100:00100000:3.0:1788970403.615336:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102289536:12345-0@lo:400:kworker.0 Request processed in 1350us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.615344:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788970403.615490:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102289536:0@lo:400:kworker.0 00000040:00080000:2.0:1788970403.868986:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970403.868995:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970403.869019:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788970403.869028:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970403.869159:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102289792:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970403.869299:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6300 going to sleep for 11 seconds 00010000:00010000:3.0:1788970403.869415:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970403.872925:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970403.873077:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082317952 00000100:00100000:0.0:1788970403.873090:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082317952 00000100:00100000:0.0:1788970403.873155:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:0.0:1788970403.873165:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082317952:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788970403.873210:0:13652:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788970403.873325:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082317952:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 161us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970403.873333:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 231 00000100:00100000:2.0:1788970403.873624:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102289792:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970403.880045:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.880260:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082318080 00000100:00100000:2.0:1788970403.880272:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082318080 00000100:00100000:2.0:1788970403.880342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:2.0:1788970403.880353:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12457:x1875871082318080:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.880456:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.880473:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.880505:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.881957:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883208:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883223:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883263:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883272:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883278:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970403.883328:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788970403.883332:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970403.883346:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883357:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883363:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883405:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883411:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970403.883415:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883423:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883435:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:2.0:1788970403.883438:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970403.883443:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883449:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f7f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883466:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883472:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883477:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883483:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970403.883485:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883501:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883510:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8a7e88bd6200) 00010000:00010000:2.0:1788970403.883512:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970403.883515:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883521:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f7f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883538:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883544:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883550:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883555:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970403.883558:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883564:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883571:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970403.883573:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970403.883576:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.883593:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f7ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.883705:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12457:x1875871082318080:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 3348us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.883717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 232 00000100:00100000:1.0:1788970403.886797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.886880:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082318336 00000100:00100000:3.0:1788970403.886891:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082318336 00000100:00100000:3.0:1788970403.886951:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:3.0:1788970403.886961:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+66:12457:x1875871082318336:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970403.886989:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970403.887010:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f806 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dad8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887112:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887128:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887139:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970403.887150:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788970403.887243:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887251:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887258:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887281:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970403.887286:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887294:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887309:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970403.887312:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970403.887317:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887323:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f80d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887366:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f806 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad8 expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887377:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:3.0:1788970403.887434:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970403.887439:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f806 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad8 expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.887450:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:3.0:1788970403.887504:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082318336:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 544us (717us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788970403.887512:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 233 00000100:00100000:1.0:1788970403.891934:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.892067:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082318464 00000100:00100000:3.0:1788970403.892099:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082318464 00000100:00100000:3.0:1788970403.892160:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 234 00000100:00100000:3.0:1788970403.892170:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082318464:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788970403.892212:0:10102:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970403.892338:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082318464:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 169us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.892347:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 234 00000100:00100000:1.0:1788970403.894983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.895235:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082318720 00000100:00100000:2.0:1788970403.895246:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082318720 00000100:00100000:2.0:1788970403.895304:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 235 00000100:00100000:2.0:1788970403.895315:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e92ceac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082318720:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.895334:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970403.895337:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788970403.895362:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c6f7ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dabc expref: 67 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.895401:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970403.895406:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970403.895420:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f81b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dadf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970403.897143:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788970403.897334:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.897350:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.897360:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.900312:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b800/0xc3abfebe76c6f81b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dadf expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.900550:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dadf expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.900561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6200) 00010000:00010000:2.0:1788970403.900564:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970403.900568:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec215a200, rc 0) 00000100:00100000:2.0:1788970403.901053:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e92ceac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+68:12457:x1875871082318720:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 5737us (6085us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788970403.901064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 235 00000100:00100000:1.0:1788970403.906629:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.906749:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082318976 00000100:00100000:2.0:1788970403.906764:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082318976 00000100:00100000:2.0:1788970403.906843:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 236 00000100:00100000:2.0:1788970403.906858:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+68:12457:x1875871082318976:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.906939:0:13652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970403.906976:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215a200/0xc3abfebe76c6f822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dadf expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907000:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6200) 00010000:00010000:2.0:1788970403.907015:0:13652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970403.907041:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907058:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907105:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907123:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907132:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907139:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907225:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907232:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907239:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907245:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215bc00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970403.907250:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907259:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907268:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:2.0:1788970403.907271:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970403.907275:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907289:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215bc00/0xc3abfebe76c6f830 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907302:0:13652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907309:0:13652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907315:0:13652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907321:0:13652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec215b600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970403.907324:0:13652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907330:0:13652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907337:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x679a12af (ffff8a7e88bd6f00) 00010000:00010000:2.0:1788970403.907340:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970403.907343:0:13652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.907348:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215b600/0xc3abfebe76c6f837 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x679a12af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.907484:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082318976:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 628us (869us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970403.907493:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 236 00000100:00100000:0.0:1788970403.909649:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.909870:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082319104 00000100:00100000:2.0:1788970403.909890:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082319104 00000100:00100000:2.0:1788970403.909971:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 237 00000100:00100000:2.0:1788970403.909983:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+67:12457:x1875871082319104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.910011:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970403.910038:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f83e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dae6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.910130:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.910146:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.910159:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.910310:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec215ae00/0xc3abfebe76c6f83e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.910338:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.910347:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970403.910350:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970403.910355:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9c00, rc 0) 00000100:00100000:2.0:1788970403.910484:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+68:12457:x1875871082319104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 504us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.910492:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 237 00000100:00100000:1.0:1788970403.913705:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.914133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082319360 00000100:00100000:2.0:1788970403.914149:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082319360 00000100:00100000:2.0:1788970403.914300:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 238 00000100:00100000:2.0:1788970403.914314:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+68:12457:x1875871082319360:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.914495:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.914516:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.914530:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970403.914876:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788970403.914888:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423181506037ns, next at 424181502969ns, rc = 0 00000004:00010000:2.0:1788970403.914950:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7b3e564 reply state 000000009db930ba transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.914966:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.914987:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970403.914990:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788970403.914996:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970403.915152:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+70:12457:x1875871082319360:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 841us (1459us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788970403.915161:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 238 00000100:00100000:1.0:1788970403.919122:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.919310:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082319488 00000100:00100000:3.0:1788970403.919323:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082319488 00000100:00100000:2.0:1788970403.919518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 239 00000100:00100000:2.0:1788970403.919536:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+70:12457:x1875871082319488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.919596:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970403.919624:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8daed expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.919706:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.919726:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.919748:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970403.919751:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970403.919756:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9a00, rc 0) 00000100:00100000:2.0:1788970403.919841:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+71:12457:x1875871082319488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 311us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.919848:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 239 00000100:00100000:3.0:1788970403.924360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970403.924785:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082319616 00000100:00100000:1.0:1788970403.924798:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082319616 00000100:00100000:1.0:1788970403.924883:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:1.0:1788970403.924896:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082319616:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788970403.925337:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2402:x1875871082319616:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 442us (990us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788970403.925345:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:0.0:1788970403.929570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970403.929694:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082319872 00000100:00100000:1.0:1788970403.929708:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082319872 00000100:00100000:1.0:1788970403.929816:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:1.0:1788970403.929829:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+71:12457:x1875871082319872:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788970403.930378:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+72:12457:x1875871082319872:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 549us (1000us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788970403.930419:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1788970403.942096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.942762:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082320128 00000100:00100000:3.0:1788970403.942780:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082320128 00000100:00100000:3.0:1788970403.942885:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 240 00000100:00100000:3.0:1788970403.942901:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+72:12457:x1875871082320128:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970403.943074:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+72:12457:x1875871082320128:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 176us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.943090:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 240 00000100:00100000:0.0:1788970403.949001:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.949596:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082320256 00000100:00100000:2.0:1788970403.949612:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082320256 00000100:00100000:2.0:1788970403.949707:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 241 00000100:00100000:2.0:1788970403.949720:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+72:12457:x1875871082320256:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.949750:0:13652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970403.949777:0:13652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f85a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8daf4 expref: -99 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.949880:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.949922:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.949936:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970403.950005:0:13652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970403.950033:0:13652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.950074:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f85a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daf4 expref: 74 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.950106:0:13652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daf4 expref: 73 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.950117:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970403.950120:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788970403.950124:0:13652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8600, rc 0) 00000100:00100000:2.0:1788970403.951196:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+73:12457:x1875871082320256:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1462us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.951208:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 241 00000100:00100000:0.0:1788970403.961319:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970403.961426:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082320384 00000100:00100000:1.0:1788970403.961440:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082320384 00000100:00100000:1.0:1788970403.961522:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:1.0:1788970403.961535:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+10:2403:x1875871082320384:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970403.961569:0:10104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970403.961597:0:10104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dafb expref: -99 pid: 10104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970403.961991:0:10104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa185a3, blocks: 0x0 00010000:00010000:1.0:1788970403.962019:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1788970403.962024:0:10104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970403.962036:0:10104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 11 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.962057:0:10104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 11 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970403.962072:0:10104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3c00, rc 0) 00000100:00100000:1.0:1788970403.962430:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+11:2403:x1875871082320384:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 897us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970403.962455:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:1.0:1788970403.967144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.967593:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082320640 00000100:00100000:3.0:1788970403.967659:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082320640 00000100:00100000:3.0:1788970403.967759:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 242 00000100:00100000:3.0:1788970403.967772:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+73:12457:x1875871082320640:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970403.968344:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+73:12457:x1875871082320640:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 570us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.968356:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 242 00000100:00100000:0.0:1788970403.971446:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.971612:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082320768 00000100:00100000:2.0:1788970403.971624:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082320768 00000100:00100000:2.0:1788970403.971800:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:2.0:1788970403.971818:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+11:12457:x1875871082320768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970403.971847:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970403.971894:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db02 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.971952:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 12 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.971963:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970403.971967:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970403.971975:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.972023:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 12 pid: 10104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.972041:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 12 pid: 10104 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.972060:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875871102289920:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970403.972450:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970403.975548:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970403.975744:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082320896 00000100:00100000:3.0:1788970403.975757:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082320896 00010000:00010000:3.0:1788970403.975830:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 13 pid: 10104 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970403.975879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:3.0:1788970403.975891:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+13:2402:x1875871082320896:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970403.975923:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970403.975955:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 13 pid: 10104 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.975971:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 13 pid: 10104 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.976005:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970403.976010:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970403.976021:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 13 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.976032:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 13 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970403.976089:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 13 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970403.976105:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875871102290048:192.168.203.15@tcp:105: 00000100:00100000:3.0:1788970403.976216:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668300 going to sleep for 11 seconds 00010000:00010000:2.0:1788970403.976499:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c6f868 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dafb expref: 13 pid: 10104 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.976518:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875871102289920:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970403.976558:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.976586:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8800, rc 0) 00000100:00100000:2.0:1788970403.976804:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+12:12457:x1875871082320768:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 4991us (5371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.976813:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:0.0:1788970403.982881:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970403.983146:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082321024 00000100:00100000:1.0:1788970403.983227:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082321024 00002000:00100000:1.0:1788970403.983307:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8a7d8451a1c0 x1875871082321024/t0(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:179/0 lens 504/0 e 0 to 0 dl 1788970414 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788970403.983321:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d8451a1c0 with x1875871082321024 ext(0->12) 00002000:00010000:1.0:1788970403.983330:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d8451a1c0 00000100:00100000:1.0:1788970403.983503:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:1.0:1788970403.983517:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+12:2403:x1875871082321024:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788970403.985582:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875871102290048:192.168.203.15@tcp:105: 00010000:00010000:3.0:1788970403.985626:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970403.985894:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+14:2402:x1875871082320896:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 10005us (10365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970403.985908:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 102 00000100:00100000:1.0:1788970403.990635:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+13:2403:x1875871082321024:12345-192.168.203.15@tcp:4:lhsmtool_posix.0 Request processed in 7109us (7763us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788970403.990652:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00002000:00100000:1.0:1788970403.990666:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8a7d8451a1c0 x1875871082321024/t4294967321(0) o4->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:179/0 lens 504/448 e 0 to 0 dl 1788970414 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788970403.990676:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d8451a1c0 with x1875871082321024 ext(0->12) 00002000:00010000:1.0:1788970403.990684:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d8451a1c0 00000100:00100000:0.0:1788970403.994021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970403.994124:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082321152 00000100:00100000:2.0:1788970403.994135:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082321152 00000100:00100000:2.0:1788970403.994210:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 243 00000100:00100000:2.0:1788970403.994222:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+73:12457:x1875871082321152:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788970403.996525:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788970403.996550:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788970403.996588:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788970403.996621:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7d82668600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788970403.996627:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d83332000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d82668540 00000020:00080000:1.0:1788970403.996630:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d83332400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7e83dd2400 00000020:00080000:1.0:1788970403.996686:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7d82591300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788970403.996701:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d82416d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d82591a80 00000020:00080000:1.0:1788970403.996705:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d82416c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d837e1600 00000020:00080000:1.0:1788970403.996719:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788970403.997018:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788970403.997100:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788970403.997111:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970403.997134:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102290304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788970403.997222:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970403.997274:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102290176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788970403.997300:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970403.997340:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102290304 00000100:00100000:2.0:1788970403.997349:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102290304 00000100:00100000:2.0:1788970403.997408:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102290176 00000100:00100000:2.0:1788970403.997412:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102290176 00000100:00100000:2.0:1788970403.997433:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970403.997441:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875871102290304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788970403.997564:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788970403.997568:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788970403 00002000:00010000:2.0:1788970403.997571:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788970403.997573:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788970403 -> 1788970403 00002000:00010000:2.0:1788970403.997583:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788970403.997725:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3650:x1875871102290304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 283us (501us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788970403.997734:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970403.997753:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788970403.997760:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102290176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788970403.997776:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1788970403.997795:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.997819:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 12 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.997828:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788970403.997833:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970403.997838:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.997869:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 12 pid: 8689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.997884:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 12 pid: 8689 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970403.997897:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875871102290432:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970403.997967:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6000 going to sleep for 11 seconds 00000004:00080000:2.0:1788970403.998015:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e8a940/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788970403.998022:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102290304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788970403.998127:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12457:x1875871082321152:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 3908us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970403.998136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 243 00000100:00100000:2.0:1788970403.998236:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102290560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788970403.998264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970403.998295:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102290560 00000100:00100000:2.0:1788970403.998299:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102290560 00000100:00100000:2.0:1788970403.998323:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788970403.998330:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875871102290560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788970403.998343:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1788970403.998365:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa185a2, atime: 0x6aa185a2, ctime: 0x6aa185a2, blocks: 0x8 00010000:00010000:2.0:1788970403.998370:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998405:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1788970403.998409:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970403.998415:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998433:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998444:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998465:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998483:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788970403.998617:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1875871102290560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (351us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788970403.998624:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1788970403.998653:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e88f00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788970403.998658:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102290560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788970403.998794:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970403.998800:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998810:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970403.998814:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998825:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998843:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998851:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000848f70e7/0xc3abfebe76c6f87d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970403.998882:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970403.998884:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970403.998886:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970404.000965:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.000999:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001006:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001012:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970404.001017:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001025:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001042:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a7e88bd6400) 00010000:00010000:0.0:1788970404.001045:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970404.001050:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001057:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5800/0xc3abfebe76c6f574 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001149:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001156:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001233:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001239:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970404.001248:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001255:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001265:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a7d83360900) 00010000:00010000:0.0:1788970404.001268:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970404.001271:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001277:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f61c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001311:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001318:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001324:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001328:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970404.001332:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001338:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001346:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:0.0:1788970404.001349:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970404.001357:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001363:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6f69a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001375:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001441:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001511:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001516:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970404.001519:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001525:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001533:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7eb55b5100) 00010000:00010000:0.0:1788970404.001536:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970404.001540:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001545:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c6f6bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.001566:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.002527:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875871102290432:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970404.002555:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.003331:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.003786:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082321280 00000100:00100000:2.0:1788970404.003797:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082321280 00000100:00100000:2.0:1788970404.003919:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:2.0:1788970404.003932:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+13:2403:x1875871082321280:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788970404.004488:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004497:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004503:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970404.004508:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004516:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004534:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:0.0:1788970404.004537:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970404.004541:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004548:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c6f78f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004574:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004580:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004586:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004591:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970404.004735:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004743:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004751:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:0.0:1788970404.004754:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788970404.004757:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.004762:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8e00/0xc3abfebe76c6f84c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.006459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970404.006766:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082321408 00000100:00100000:3.0:1788970404.006776:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082321408 00010000:00010000:3.0:1788970404.006814:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 14 pid: 8689 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.006852:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 103 00000100:00100000:3.0:1788970404.006860:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+14:2402:x1875871082321408:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970404.006875:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970404.006882:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 14 pid: 8689 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.006896:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 14 pid: 8689 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.006922:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c6f62a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da5a expref: 14 pid: 8689 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.006940:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970404.006945:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970404.006950:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.006981:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.007008:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970404.007058:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+13:2402:x1875871082321408:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 198us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970404.007065:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 103 00010000:00010000:2.0:1788970404.007359:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.007370:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.007403:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.007411:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.007425:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970404.007740:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970404.007747:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.007755:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970404.007760:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.007769:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.007782:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.007789:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c284ce0/0xc3abfebe76c6f876 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.007806:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970404.007813:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970404.007814:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970404.007997:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875871102290176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10235us (10694us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788970404.008006:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1788970404.009047:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e8a580/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788970404.009056:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102290176:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788970404.011721:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788970404.012055:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788970404.012067:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788970404.012872:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082321280:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 8937us (9538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970404.012885:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:3.0:1788970404.015076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.015349:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082321664 00000100:00100000:2.0:1788970404.015360:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082321664 00000100:00100000:2.0:1788970404.015713:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 244 00000100:00100000:2.0:1788970404.015725:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12457:x1875871082321664:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970404.015779:0:13652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970404.015807:0:13652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daf4 expref: 21 pid: 13652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.015825:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970404.015830:0:13652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970404.015859:0:13652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.015875:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.015884:0:13652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970404.016003:0:13652:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070cc49d0 reply state 000000009f681680 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.016014:0:13652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.016035:0:13652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970404.016037:0:13652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970404.016040:0:13652:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970404.016155:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+22:12457:x1875871082321664:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 432us (1090us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788970404.016171:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 244 00000100:00100000:3.0:1788970404.019692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970404.019769:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082321792 00000100:00100000:1.0:1788970404.019779:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082321792 00000100:00100000:1.0:1788970404.019826:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:1.0:1788970404.019835:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082321792:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788970404.019971:0:8689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788970404.019974:0:8689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788970403 -> 1788970402 00002000:00010000:1.0:1788970404.019977:0:8689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788970402 00002000:00010000:1.0:1788970404.019980:0:8689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788970403 -> 1788970402 00002000:00010000:1.0:1788970404.019983:0:8689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788970404.020032:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082321792:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 197us (349us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788970404.020039:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:3.0:1788970404.022542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.023132:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322048 00000100:00100000:2.0:1788970404.023144:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322048 00000100:00100000:2.0:1788970404.023219:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 245 00000100:00100000:2.0:1788970404.023230:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:12457:x1875871082322048:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788970404.023307:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.023325:0:10102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.023336:0:10102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.023371:0:10102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.023402:0:10102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 22 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.023416:0:10102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102290688:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970404.023493:0:10102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970404.026500:0:10102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102290688:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970404.026533:0:10102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.032829:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970404.033665:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322176 00000100:00100000:0.0:1788970404.033681:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322176 00010000:00010000:0.0:1788970404.033731:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 23 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970404.033780:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 104 00000100:00100000:0.0:1788970404.033791:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+23:2402:x1875871082322176:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970404.033808:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970404.033816:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 23 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.033831:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 23 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.033855:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c6f845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dae6 expref: 23 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.033896:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:0.0:1788970404.033902:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.033912:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.033921:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.033962:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970404.034043:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+22:2402:x1875871082322176:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 254us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970404.034051:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 104 00010000:00010000:2.0:1788970404.034255:0:10102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034264:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034308:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034316:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034323:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034330:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970404.034334:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034343:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034353:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970404.034356:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788970404.034359:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.034366:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f88b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.034446:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12457:x1875871082322048:12345-192.168.203.15@tcp:55:lhsmtool_posix.0 Request processed in 11218us (11910us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788970404.034455:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 245 00000100:00100000:3.0:1788970404.036902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.036978:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322304 00000100:00100000:2.0:1788970404.036988:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322304 00000100:00100000:2.0:1788970404.037053:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:2.0:1788970404.037063:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082322304:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788970404.037108:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.037128:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.037137:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970404.037141:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970404.037146:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.037193:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.037208:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 8 pid: 8442 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.037226:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875871102290816:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970404.037331:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970404.045012:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875871102290816:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970404.045045:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.049113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.049209:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322432 00000100:00100000:2.0:1788970404.049218:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322432 00010000:00010000:2.0:1788970404.049257:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 9 pid: 8442 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.049333:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:2.0:1788970404.049343:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+9:2402:x1875871082322432:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970404.049360:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970404.049424:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 9 pid: 8442 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.049439:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 9 pid: 8442 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.049470:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007be81c78/0xc3abfebe76c6f86f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db02 expref: 9 pid: 8442 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.049485:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970404.049488:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970404.049494:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.049519:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.049552:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970404.049759:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049769:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049790:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049798:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049806:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049825:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970404.049830:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049839:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049852:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.049861:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c6f892 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.049933:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2402:x1875871082322432:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 591us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970404.049941:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 105 00000100:00100000:3.0:1788970404.050771:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082322304:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 13704us (13873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970404.050782:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:3.0:1788970404.055950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.056042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322688 00000100:00100000:2.0:1788970404.056055:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322688 00000100:00100000:2.0:1788970404.056133:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 246 00000100:00100000:2.0:1788970404.056147:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:12457:x1875871082322688:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788970404.056259:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.056276:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 21 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.056285:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.056321:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 21 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.056335:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 21 pid: 10102 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.056371:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102290944:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970404.056494:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970404.059964:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.060128:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102290944:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970404.060154:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970404.061899:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322816 00000100:00100000:0.0:1788970404.061916:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322816 00010000:00010000:2.0:1788970404.062629:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 22 pid: 10102 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.062715:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 106 00000100:00100000:2.0:1788970404.062735:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+22:2403:x1875871082322816:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970404.062751:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970404.062757:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 22 pid: 10102 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062770:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 22 pid: 10102 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062791:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c6f788 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daae expref: 22 pid: 10102 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062806:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970404.062811:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062838:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062846:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062853:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.062886:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970404.062953:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+21:2403:x1875871082322816:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 229us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970404.062961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 106 00010000:00010000:0.0:1788970404.063016:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.063024:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.063230:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.063243:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.063252:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.063289:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970404.063303:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 21 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970404.063316:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102291072:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970404.063372:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970404.066869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970404.066939:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082322944 00000100:00100000:3.0:1788970404.066948:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082322944 00010000:00010000:3.0:1788970404.066987:0:7932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 22 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.067034:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 107 00000100:00100000:3.0:1788970404.067044:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:2403:x1875871082322944:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970404.067059:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970404.067090:0:7932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 22 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.067103:0:7932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 22 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.067124:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:3.0:1788970404.067129:0:7932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.067139:0:7932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.067147:0:7932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.067282:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970404.067334:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+22:2403:x1875871082322944:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 291us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970404.067342:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 107 00010000:00010000:2.0:1788970404.067838:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daed expref: 21 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.067854:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102291072:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970404.067876:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.067886:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.067893:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970404.068002:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788970404.068131:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788970404.068280:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788970404.068375:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102291200:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970404.068465:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970404.068491:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92b6a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970404.068556:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102291200 00000100:00100000:3.0:1788970404.068562:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102291200 00000100:00100000:3.0:1788970404.068604:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788970404.068613:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1875871102291200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788970404.068690:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1875871102291200:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970404.068696:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788970404.068833:0:6525:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788970404.068839:0:6525:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788970404.068867:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e8a940, transno 4294967322 00000100:00100000:2.0:1788970404.068891:0:6525:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a7d83e8a580 x1875871102290176/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788970419 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970404.068902:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102291200:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788970404.068999:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788970404.069035:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102291328:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970404.069062:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970404.069199:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970404.070533:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102291328 00000100:00100000:0.0:1788970404.070544:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102291328 00000100:00100000:0.0:1788970404.070644:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788970404.070654:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1875871102291328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788970404.070833:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6525:x1875871102291328:12345-0@lo:1000:mdt00_001.0 Request processed in 180us (1769us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788970404.070841:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788970404.070912:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6525:1875871102291328:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788970404.070958:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.070968:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.070976:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.070982:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970404.070987:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.070995:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071022:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970404.071025:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970404.071031:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071037:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012a00/0xc3abfebe76c6f8a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071064:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071071:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071077:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071082:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970404.071097:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071104:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071114:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970404.071116:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970404.071123:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071135:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071152:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.071204:0:6525:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.071217:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102291456:192.168.203.15@tcp:105: 00000100:00100000:2.0:1788970404.071287:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970404.075355:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970404.075469:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082323072 00000100:00100000:3.0:1788970404.075478:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082323072 00000100:00100000:3.0:1788970404.075547:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:3.0:1788970404.075557:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+25:12456:x1875871082323072:12345-192.168.203.15@tcp:49:lfs.0 00000100:00100000:3.0:1788970404.075686:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+25:12456:x1875871082323072:12345-192.168.203.15@tcp:49:lfs.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970404.075694:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1788970404.075868:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875871102291456:192.168.203.15@tcp:105: 00010000:00010000:2.0:1788970404.075897:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075907:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c6f7e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075937:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075952:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075964:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075973:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075981:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.075995:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076001:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970404.076005:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076013:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076024:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970404.076027:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970404.076031:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076038:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076047:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076053:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076059:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076065:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970404.076068:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076096:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076105:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970404.076107:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970404.076110:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.076116:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f899 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.076252:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+24:12457:x1875871082322688:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 20109us (20315us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788970404.076260:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 246 00000020:00080000:2.0:1788970404.076264:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788970404.076457:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970404.076462:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970404.076962:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788970404.076969:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970404.080794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970404.080830:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.080892:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082323584 00000100:00100000:2.0:1788970404.080902:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082323584 00000100:00100000:2.0:1788970404.080961:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00100000:2.0:1788970404.080970:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+24:12456:x1875871082323584:12345-192.168.203.15@tcp:58:lfs.0 00000040:00080000:2.0:1788970404.081143:0:13652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788970404.081232:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+24:12456:x1875871082323584:12345-192.168.203.15@tcp:58:lfs.0 Request processed in 262us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970404.081240:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 247 00000100:00100000:3.0:1788970404.081434:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082323328 00000100:00100000:3.0:1788970404.081439:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082323328 00000100:00100000:3.0:1788970404.081469:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:3.0:1788970404.081476:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+24:12457:x1875871082323328:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788970404.081641:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788970404.081669:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788970404.081698:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.081713:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.081725:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.081734:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.081740:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.081763:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.081776:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788970404.081822:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+26:12457:x1875871082323328:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 346us (1035us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788970404.081828:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000020:00080000:3.0:1788970404.081832:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788970404.081928:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970404.081934:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.081941:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970404.081952:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.081961:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.081973:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970404.081976:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788970404.081981:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.081987:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c6f8ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.081997:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970404.081999:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970404.082001:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970404.119907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.119997:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082323712 00000100:00100000:2.0:1788970404.120007:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082323712 00000100:00100000:2.0:1788970404.120068:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 248 00000100:00100000:2.0:1788970404.120092:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+26:12459:x1875871082323712:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970404.120117:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970404.120137:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f8b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db09 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120215:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120230:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120254:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120285:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120292:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120299:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120423:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120434:0:10102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120448:0:10102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120486:0:10102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.120500:0:10102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 27 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970404.120514:0:10102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102291584:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970404.120612:0:10102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970404.127719:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970404.128243:0:10102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10102:1875871102291584:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970404.128272:0:10102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.128643:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082323968 00000100:00100000:3.0:1788970404.128652:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082323968 00000100:00100000:3.0:1788970404.128744:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:3.0:1788970404.128755:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+28:6172:x1875871082323968:12345-192.168.203.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788970404.129002:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+29:6172:x1875871082323968:12345-192.168.203.15@tcp:35:ldlm_bl.0 Request processed in 249us (1294us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788970404.129010:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1788970404.136194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970404.137431:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082324096 00000100:00100000:3.0:1788970404.137516:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082324096 00010000:00010000:3.0:1788970404.137572:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 29 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970404.137622:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 108 00000100:00100000:3.0:1788970404.137644:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+29:2402:x1875871082324096:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970404.137658:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970404.137665:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 29 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.137698:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 29 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.137721:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f7d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8daca expref: 29 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.137748:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970404.137753:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.137762:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.137770:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970404.138202:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970404.138314:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+28:2402:x1875871082324096:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 669us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970404.138323:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 108 00010000:00010000:3.0:1788970404.138357:0:10102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138364:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970404.138442:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788970404.138453:0:10102:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970404.138470:0:10102:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138481:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138497:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138502:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138507:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138511:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970404.138514:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138519:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138526:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:3.0:1788970404.138528:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970404.138531:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138534:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c6f8bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138544:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138550:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138566:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138584:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970404.138587:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138594:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138603:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a7e88bd6f00) 00010000:00010000:3.0:1788970404.138606:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970404.138609:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138615:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c6f8c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138669:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8c00/0xc3abfebe76c6f8b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db09 expref: 28 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138681:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db09 expref: 27 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970404.138687:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970404.138688:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970404.138690:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8200, rc 0) 00000100:00100000:3.0:1788970404.138715:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12459:x1875871082323712:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 18639us (18820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970404.138721:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 248 00000040:00080000:3.0:1788970404.824113:0:14715:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970404.824128:0:14715:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970404.824167:0:14715:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788970404.824187:0:14715:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788970404.892511:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970405.084678:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970405.084687:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970405.084712:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788970405.084721:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970405.084875:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102291712:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970405.085039:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d83653cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970405.087762:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13805:1875871102291712:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970405.090086:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970405.090778:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082324224 00000100:00100000:2.0:1788970405.090853:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082324224 00000100:00080000:1.0:1788970405.090915:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970405.090934:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:2.0:1788970405.090948:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12471:x1875871082324224:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970405.090983:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970405.091143:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12471:x1875871082324224:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 199us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970405.091152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 249 00000100:00100000:0.0:1788970405.100501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970405.100597:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082324480 00000100:00100000:1.0:1788970405.100607:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082324480 00000100:00100000:1.0:1788970405.100665:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:1.0:1788970405.100675:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+27:12471:x1875871082324480:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970405.100695:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970405.100727:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f8d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970405.102016:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f8d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970405.102034:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970405.102046:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970405.102058:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788970405.102183:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6f8d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db10 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970405.102204:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db10 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970405.102213:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:1.0:1788970405.102217:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970405.102220:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2000, rc 0) 00000100:00100000:1.0:1788970405.102285:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+29:12471:x1875871082324480:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1610us (1792us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788970405.102293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 250 00000100:00100000:0.0:1788970405.111960:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970405.114703:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082324608 00000100:00100000:3.0:1788970405.114718:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082324608 00000100:00100000:0.0:1788970405.117702:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970405.117884:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082324864 00000100:00100000:3.0:1788970405.117895:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082324864 00000100:00100000:3.0:1788970405.118004:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:3.0:1788970405.118015:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+30:12471:x1875871082324864:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788970405.118093:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118111:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118124:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118288:0:10102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118297:0:10102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118304:0:10102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118310:0:10102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970405.118315:0:10102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118322:0:10102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118350:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970405.118354:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970405.118360:0:10102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970405.118365:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970405.118819:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+31:12471:x1875871082324864:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 803us (1123us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788970405.118827:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 251 00000100:00100000:2.0:1788970405.122900:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1788970405.122913:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+30:2400:x1875871082324608:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970405.122929:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970405.122955:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c6f8d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db10 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970405.122979:0:7932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:2.0:1788970405.122984:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970405.123044:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+29:2400:x1875871082324608:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 133us (11095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970405.123082:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000040:00080000:0.0:1788970405.123518:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970405.123523:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970405.124010:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788970405.124022:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970405.139008:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970405.139549:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325120 00000100:00100000:2.0:1788970405.139560:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325120 00000100:00100000:2.0:1788970405.139670:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:2.0:1788970405.139682:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+29:12471:x1875871082325120:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970405.139965:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+30:12471:x1875871082325120:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 284us (967us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788970405.139973:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970405.148664:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102291840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970405.148742:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970405.148938:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102291840 00000100:00100000:1.0:1788970405.148947:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102291840 00000100:00100000:1.0:1788970405.149005:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788970405.149015:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102291840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970405.149053:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788970405.149132:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102291968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970405.149161:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970405.149212:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102291968 00000100:00100000:3.0:1788970405.149216:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102291968 00000100:00100000:3.0:1788970405.149238:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788970405.149244:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102291968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788970405.149255:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788970405.149287:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102291968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970405.149293:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788970405.149337:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102291968:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788970405.149375:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970405.154807:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102291840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5783us (6054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970405.154822:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788970405.154961:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102291840:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788970405.664463:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788970405.664482:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:2.0:1788970405.916755:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970406.084575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970406.084628:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325376 00000100:00100000:2.0:1788970406.084641:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325376 00000100:00100000:2.0:1788970406.084705:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 317 00000100:00100000:2.0:1788970406.084716:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+30:2403:x1875871082325376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970406.084802:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+30:2403:x1875871082325376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970406.084811:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 317 00000100:00100000:3.0:1788970406.090312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.090420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.090453:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.090478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.090504:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325760 00000100:00100000:3.0:1788970406.090514:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325760 00000100:00100000:3.0:1788970406.090580:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:3.0:1788970406.090590:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082325760:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970406.090656:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082325760:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970406.090664:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:3.0:1788970406.090686:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325504 00000100:00100000:3.0:1788970406.090690:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325504 00000100:00100000:3.0:1788970406.090713:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326016 00000100:00100000:3.0:1788970406.090716:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326016 00000100:00100000:3.0:1788970406.090734:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 318 00000100:00100000:3.0:1788970406.090741:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082325504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970406.090770:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 319 00000100:00100000:3.0:1788970406.090773:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082325504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970406.090782:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 318 00000100:00100000:1.0:1788970406.090787:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082326016:12345-192.168.203.15@tcp:400:kworker.0 00000100:00080000:3.0:1788970406.090804:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970406.090810:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970406.090827:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082326016:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970406.090837:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 319 00000100:00100000:2.0:1788970406.092858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325248 00000100:00100000:2.0:1788970406.092870:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325248 00000100:00100000:2.0:1788970406.092933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 385 00000100:00100000:2.0:1788970406.092943:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082325248:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970406.093011:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082325248:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 70us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970406.093019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 385 00000100:00100000:3.0:1788970406.096235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.096285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970406.096419:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325888 00000100:00100000:2.0:1788970406.096429:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325888 00000100:00100000:2.0:1788970406.096491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 320 00000100:00100000:2.0:1788970406.096501:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082325888:12345-192.168.203.15@tcp:400:kworker.0 00000100:00080000:3.0:1788970406.096694:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970406.096750:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2403:x1875871082325888:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 250us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970406.096759:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 320 00000100:00100000:0.0:1788970406.097583:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082325632 00000100:00100000:0.0:1788970406.097592:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082325632 00000100:00100000:0.0:1788970406.097752:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:0.0:1788970406.097761:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082325632:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970406.097802:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2403:x1875871082325632:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 43us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970406.097808:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00080000:2.0:1788970406.097900:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970406.172746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102292096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970406.172838:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970406.172976:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292096 00000100:00100000:2.0:1788970406.172984:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292096 00000100:00100000:2.0:1788970406.173042:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788970406.173053:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102292096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970406.173089:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788970406.173159:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102292096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970406.173177:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788970406.173342:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102292096:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788970406.724776:0:14767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788970406.724786:0:14767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970406.724822:0:14767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788970406.724828:0:14767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788970406.860004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.860705:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326272 00000100:00100000:3.0:1788970406.860835:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326272 00000100:00100000:3.0:1788970406.860907:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:3.0:1788970406.860917:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+30:12491:x1875871082326272:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970406.860935:0:10102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970406.860957:0:10102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f8ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db17 expref: -99 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.861071:0:10102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.861087:0:10102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.861101:0:10102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10102 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970406.861113:0:10102:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788970406.861227:0:10102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c6f8ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db17 expref: 33 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.861244:0:10102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db17 expref: 32 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.861252:0:10102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970406.861255:0:10102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788970406.861259:0:10102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:3.0:1788970406.861325:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+32:12491:x1875871082326272:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 409us (1329us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788970406.861332:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 252 00000100:00100000:0.0:1788970406.869140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.869438:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326400 00000100:00100000:3.0:1788970406.869448:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326400 00000100:00100000:3.0:1788970406.869502:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 253 00000100:00100000:3.0:1788970406.869513:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+32:12491:x1875871082326400:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:3.0:1788970406.869645:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869665:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869678:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869785:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869793:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869800:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869806:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970406.869810:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869818:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869830:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:3.0:1788970406.869833:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970406.869837:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.869853:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c6f902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970406.869917:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+32:12491:x1875871082326400:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 406us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970406.869983:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 253 00010000:00010000:2.0:1788970406.940978:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970406.966330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.969539:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326528 00000100:00100000:3.0:1788970406.969556:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326528 00000100:00100000:3.0:1788970406.969644:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:3.0:1788970406.969656:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2401:x1875871082326528:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:3.0:1788970406.969677:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970406.969697:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f909 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db1e expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970406.969723:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa185a2, atime: 0x6aa185a2, ctime: 0x6aa185a2, blocks: 0x8 00010000:00010000:3.0:1788970406.969744:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788970406.969748:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970406.969758:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f909 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db1e expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.969773:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f909 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db1e expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970406.969785:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:3.0:1788970406.969914:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2401:x1875871082326528:12345-192.168.203.15@tcp:101:cat.0 Request processed in 260us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970406.969938:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:1.0:1788970406.975706:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970406.975889:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326656 00000100:00100000:3.0:1788970406.975898:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326656 00002000:00100000:3.0:1788970406.975948:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8a7d83e8f0c0 x1875871082326656/t0(0) o3->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:182/0 lens 488/0 e 0 to 0 dl 1788970417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970406.975959:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e8f0c0 with x1875871082326656 ext(0->4095) 00002000:00010000:3.0:1788970406.975964:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83e8f0c0 00000100:00100000:3.0:1788970406.976038:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1788970406.976048:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082326656:12345-192.168.203.15@tcp:3:cat.0 00000100:00100000:3.0:1788970406.976261:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+8:2403:x1875871082326656:12345-192.168.203.15@tcp:3:cat.0 Request processed in 213us (563us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788970406.976268:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00002000:00100000:3.0:1788970406.976274:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8a7d83e8f0c0 x1875871082326656/t0(0) o3->76727560-d4e0-4213-a4e0-b609fd69db0f@192.168.203.15@tcp:182/0 lens 488/4536 e 0 to 0 dl 1788970417 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788970406.976281:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d83e8f0c0 with x1875871082326656 ext(0->4095) 00002000:00010000:3.0:1788970406.976285:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a7d83e8f0c0 00000100:00100000:3.0:1788970407.712892:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102292224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970407.712989:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970407.713190:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292224 00000100:00100000:0.0:1788970407.713201:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292224 00000100:00100000:0.0:1788970407.713270:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788970407.713280:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102292224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970407.713334:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788970407.713427:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102292224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970407.713436:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788970407.713503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102292224:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788970407.964531:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970408.732742:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.732820:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.732875:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102293120:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.732898:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.732924:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102293632:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.732943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.732982:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788970408.732988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102292736:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733008:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.733030:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102293248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733051:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.733066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.733142:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292608 00000100:00100000:1.0:1788970408.733159:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292608 00000100:00100000:1.0:1788970408.733201:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788970408.733210:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e88331850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102292608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733264:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e88331850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102292608:12345-0@lo:400:kworker.0 Request processed in 55us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.733271:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788970408.733578:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293120 00000100:00100000:1.0:1788970408.733583:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293120 00000100:00100000:1.0:1788970408.733615:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293632 00000100:00100000:1.0:1788970408.733618:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293632 00000100:00100000:1.0:1788970408.733631:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292736 00000100:00100000:1.0:1788970408.733633:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292736 00000100:00100000:1.0:1788970408.733645:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788970408.733651:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102293120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733682:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102293120:12345-0@lo:400:kworker.0 Request processed in 32us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.733688:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788970408.733699:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788970408.733704:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102293632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733726:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102293632:12345-0@lo:400:kworker.0 Request processed in 23us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.733731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788970408.733740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788970408.733746:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102292736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733770:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102292736:12345-0@lo:400:kworker.0 Request processed in 24us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.733782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788970408.733807:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293248 00000100:00100000:1.0:1788970408.733811:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293248 00000100:00100000:1.0:1788970408.733835:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293760 00000100:00100000:1.0:1788970408.733838:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293760 00000100:00100000:1.0:1788970408.733855:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788970408.733862:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102293248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733894:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102293248:12345-0@lo:400:kworker.0 Request processed in 33us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.733900:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788970408.733912:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788970408.733918:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102293760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.733945:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102293760:12345-0@lo:400:kworker.0 Request processed in 27us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.733950:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788970408.733998:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102292736:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.734011:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102293248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.734021:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.734030:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102292608:0@lo:400:kworker.0 00010000:00080000:1.0:1788970408.734041:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4f00 x1875871102293120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970408.734051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102293120:0@lo:400:kworker.0 00010000:00080000:1.0:1788970408.734060:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee43c0 x1875871102293632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970408.734077:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102293632:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736138:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102292352:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736238:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736301:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102292864:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736329:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736353:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102293376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736434:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736457:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736476:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736501:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788970408.736508:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102292480:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736531:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736552:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102292992:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736569:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736585:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102293504:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736603:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970408.736642:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292480 00000100:00100000:3.0:1788970408.736651:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292480 00000100:00100000:3.0:1788970408.736687:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292992 00000100:00100000:3.0:1788970408.736690:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292992 00000100:00100000:3.0:1788970408.736705:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293504 00000100:00100000:3.0:1788970408.736708:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293504 00000100:00100000:3.0:1788970408.736722:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788970408.736730:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102292480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736780:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102292480:12345-0@lo:400:kworker.0 Request processed in 51us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970408.736786:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788970408.736801:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788970408.736807:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102292992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736831:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102292992:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970408.736837:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788970408.736855:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788970408.736862:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102293504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736891:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102293504:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970408.736896:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788970408.736914:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293376 00000100:00100000:3.0:1788970408.736918:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293376 00000100:00100000:3.0:1788970408.736942:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102293888 00000100:00100000:3.0:1788970408.736945:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102293888 00000100:00100000:3.0:1788970408.736958:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788970408.736964:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.736992:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102293376:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970408.736998:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788970408.737009:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788970408.737014:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102293888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737038:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102293888:12345-0@lo:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970408.737043:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788970408.737066:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292864 00000100:00100000:3.0:1788970408.737069:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292864 00000100:00100000:3.0:1788970408.737092:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788970408.737098:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102292864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737129:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102292864:12345-0@lo:400:kworker.0 Request processed in 31us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970408.737135:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788970408.737198:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102292480:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737219:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102292992:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737228:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102293504:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737236:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102292864:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737244:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102293376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970408.737251:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788970408.737257:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788970408.737290:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83ed8f00, transno 4294967308 00000004:00080000:3.0:1788970408.737298:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788970408.737317:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e88f00, transno 4294967311 00000100:00100000:3.0:1788970408.737323:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102293888:0@lo:400:kworker.0 00000100:00080000:2.0:1788970408.737800:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970408.737805:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970408.737808:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970408.737810:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970408.737930:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970408.737943:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970408.738001:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970408.738038:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294016 00000100:00100000:2.0:1788970408.738042:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294016 00000100:00100000:2.0:1788970408.738084:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788970408.738091:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102294016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970408.738111:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970408.738157:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102294016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970408.738163:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788970408.738202:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970408.738691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102292352 00000100:00100000:1.0:1788970408.738696:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102292352 00000100:00100000:1.0:1788970408.738729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788970408.738735:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970408.738780:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102292352:12345-0@lo:400:kworker.0 Request processed in 45us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.738785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788970408.742445:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788970408.742751:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970408.742765:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102294144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970408.742828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970408.743095:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294144 00000100:00100000:1.0:1788970408.743102:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294144 00000100:00100000:1.0:1788970408.743161:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788970408.743172:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebc9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102294144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970408.743195:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970408.743253:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebc9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102294144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970408.743260:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788970408.743716:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102294144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788970408.988533:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788970409.768787:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788970409.768821:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7eaecf6000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788970409.768825:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d83223a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7e91b31480 00000020:00080000:3.0:1788970409.768829:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d83223100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d835dc200 00000020:00080000:3.0:1788970409.768848:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788970409.768859:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788970409.768925:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788970409.768976:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970409.768987:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970409.768994:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970409.769000:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970409.769006:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970409.769013:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970409.769032:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970409.769035:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970409.769039:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970409.769045:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c6f884 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13652 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970409.770520:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1788970409.770530:0:8435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:2.0:1788970410.012619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970410.272614:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102294272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970410.272681:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970410.272799:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294272 00000100:00100000:3.0:1788970410.272807:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294272 00000100:00100000:3.0:1788970410.272861:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788970410.272869:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102294272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970410.272912:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788970410.272957:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102294272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970410.272964:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1788970410.273104:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970410.273129:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788970410.273145:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e8a580, transno 4294967323 00000004:00080000:0.0:1788970410.273159:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788970410.273184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102294272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970410.273770:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970410.273783:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102294400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970410.273818:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970410.273978:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294400 00000100:00100000:2.0:1788970410.273984:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294400 00000100:00100000:2.0:1788970410.274027:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788970410.274150:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970410.274181:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102294400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970410.274197:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788970410.274244:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102294400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 210us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970410.274250:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788970410.274317:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102294400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788970411.037173:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970411.101063:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788970411.215580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970411.215626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970411.215680:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326784 00000100:00100000:1.0:1788970411.215691:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326784 00000100:00100000:0.0:1788970411.215713:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970411.215750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 387 00000100:00100000:0.0:1788970411.215758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970411.215763:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082326784:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970411.215823:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327296 00000100:00100000:2.0:1788970411.215828:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327296 00000100:00100000:1.0:1788970411.215836:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2402:x1875871082326784:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970411.215844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 387 00000100:00100000:2.0:1788970411.215880:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:2.0:1788970411.215891:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082327296:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970411.215925:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082327296:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.215932:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00080000:1.0:1788970411.216489:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970411.221297:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327040 00000100:00100000:3.0:1788970411.221314:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327040 00000100:00100000:2.0:1788970411.222262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327552 00000100:00100000:2.0:1788970411.222270:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327552 00000100:00100000:2.0:1788970411.222329:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 327 00000100:00100000:2.0:1788970411.222340:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082327040:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970411.222433:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2402:x1875871082327040:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 96us (6806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.222440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 327 00000100:00100000:2.0:1788970411.222456:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 328 00000100:00100000:2.0:1788970411.222462:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082327552:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970411.222504:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082327552:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 41us (6748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.222510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 328 00000100:00100000:0.0:1788970411.222818:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970411.222841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970411.222867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970411.222894:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327168 00000100:00100000:0.0:1788970411.222899:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327168 00000100:00100000:2.0:1788970411.222919:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082326912 00000100:00100000:2.0:1788970411.222923:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082326912 00000100:00080000:1.0:1788970411.222933:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970411.222934:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:0.0:1788970411.222944:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082327168:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970411.222947:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327424 00000100:00080000:1.0:1788970411.222947:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970411.222951:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327424 00000100:00080000:1.0:1788970411.222953:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970411.222959:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970411.222975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 329 00000100:00100000:0.0:1788970411.222981:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2402:x1875871082327168:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.222982:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2402:x1875871082326912:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970411.222989:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:2.0:1788970411.223012:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2402:x1875871082326912:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.223019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 329 00000100:00100000:2.0:1788970411.223055:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 330 00000100:00100000:2.0:1788970411.223062:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082327424:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970411.223099:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2402:x1875871082327424:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 38us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.223106:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 330 00000100:00100000:2.0:1788970411.292558:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970411.292580:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102294528:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788970411.292581:0:13805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788970411.292590:0:13805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970411.292613:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788970411.292627:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788970411.292656:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970411.293142:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294528 00000100:00100000:1.0:1788970411.293161:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294528 00000100:00100000:1.0:1788970411.293210:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788970411.293220:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102294528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970411.293261:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788970411.293321:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102294528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970411.293330:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788970411.293823:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102294528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970411.355454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970411.356069:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327680 00000100:00100000:2.0:1788970411.356079:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327680 00000100:00100000:2.0:1788970411.356163:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 254 00000100:00100000:2.0:1788970411.356175:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+18:12145:x1875871082327680:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788970411.356294:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+18:12145:x1875871082327680:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 120us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.356302:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 254 00000100:00100000:1.0:1788970411.361222:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970411.361433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082327808 00000100:00100000:2.0:1788970411.361443:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082327808 00000100:00100000:2.0:1788970411.361511:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 255 00000100:00100000:2.0:1788970411.361522:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:12145:x1875871082327808:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788970411.361636:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:12145:x1875871082327808:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 117us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970411.361644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 255 00000100:00100000:1.0:1788970411.368982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970411.369309:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328064 00000100:00100000:2.0:1788970411.369320:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328064 00000100:00100000:2.0:1788970411.369477:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:2.0:1788970411.369489:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+18:12145:x1875871082328064:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970411.369890:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:12145:x1875871082328064:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 403us (919us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788970411.369899:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00010000:00010000:2.0:1788970412.060702:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970412.829591:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970412.829619:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102294656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970412.829691:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970412.829824:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294656 00000100:00100000:1.0:1788970412.829832:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294656 00000100:00100000:1.0:1788970412.829867:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788970412.829873:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102294656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970412.829909:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788970412.829959:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102294656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970412.829966:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788970412.830024:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102294656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970413.084740:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788970413.108871:0:14963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:13:31 (1788970411) 00000100:00100000:1.0:1788970413.852851:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102294784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970413.852915:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.853007:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294784 00000100:00100000:1.0:1788970413.853013:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294784 00000100:00100000:1.0:1788970413.853073:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788970413.853082:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102294784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970413.853118:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970413.853178:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102294784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.853186:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788970413.853210:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102294912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970413.853234:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788970413.853264:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970413.853275:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102294912 00000100:00100000:1.0:1788970413.853279:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102294912 00000100:00100000:1.0:1788970413.853316:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788970413.853322:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102294912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970413.853332:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970413.853361:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102294912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.853367:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788970413.853378:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970413.853434:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102294912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970413.853462:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102294784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970413.853679:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102295040:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.853707:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.853729:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102295552:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.853751:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.853768:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.853787:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.853803:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788970413.853809:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102295424:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.853842:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.853860:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.853879:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.853902:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295040 00000100:00100000:1.0:1788970413.853906:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295040 00000100:00100000:1.0:1788970413.853931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788970413.853937:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102295040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.853969:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3652:x1875871102295040:12345-0@lo:400:kworker.0 Request processed in 32us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.853976:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788970413.853986:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102295168:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854000:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295424 00000100:00100000:1.0:1788970413.854003:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295424 00000100:00100000:3.0:1788970413.854028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.854029:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788970413.854035:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102295424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970413.854047:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102295680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970413.854065:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.854065:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102295424:12345-0@lo:400:kworker.0 Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854071:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788970413.854080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102296192:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854080:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295168 00000100:00100000:1.0:1788970413.854083:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295168 00000100:00100000:1.0:1788970413.854099:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295680 00000100:00100000:1.0:1788970413.854101:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295680 00000100:00100000:1.0:1788970413.854132:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788970413.854138:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102295168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854165:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102295168:12345-0@lo:400:kworker.0 Request processed in 27us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854171:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788970413.854182:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788970413.854195:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102295680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854222:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102295680:12345-0@lo:400:kworker.0 Request processed in 28us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788970413.854247:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296064 00000100:00100000:1.0:1788970413.854250:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296064 00000100:00100000:1.0:1788970413.854275:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295936 00000100:00100000:1.0:1788970413.854277:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295936 00000100:00100000:1.0:1788970413.854295:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788970413.854302:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102296064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854332:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102296064:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854337:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788970413.854347:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788970413.854353:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102295936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854378:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102295936:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854405:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788970413.854430:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970413.854434:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970413.854446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102295296:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.854487:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102295808:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854505:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.854519:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102296320:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854536:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970413.854570:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295552 00000100:00100000:1.0:1788970413.854574:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295552 00000100:00100000:1.0:1788970413.854599:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295296 00000100:00100000:1.0:1788970413.854602:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295296 00000100:00100000:1.0:1788970413.854614:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788970413.854620:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102295552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854652:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102295552:12345-0@lo:400:kworker.0 Request processed in 32us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854658:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788970413.854669:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788970413.854675:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102295296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854703:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102295296:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854708:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788970413.854726:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102295808 00000100:00100000:1.0:1788970413.854730:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102295808 00000100:00100000:1.0:1788970413.854750:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296320 00000100:00100000:1.0:1788970413.854753:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296320 00000100:00100000:1.0:1788970413.854766:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788970413.854772:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854799:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102295808:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854804:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788970413.854816:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788970413.854822:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102296320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854847:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102296320:12345-0@lo:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970413.854863:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:1.0:1788970413.854879:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970413.854902:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102295424:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854914:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854922:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:3652:1875871102295040:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854931:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102295552:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854939:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788970413.854971:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102295296:0@lo:400:kworker.0 00010000:00080000:1.0:1788970413.854982:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee5680 x1875871102295808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970413.854993:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102295808:0@lo:400:kworker.0 00010000:00080000:1.0:1788970413.855001:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83e8c780 x1875871102296320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970413.855009:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102296320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970413.857143:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970413.857220:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102295168:0@lo:400:kworker.0 00000100:00100000:3.0:1788970413.857236:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102295680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970413.857265:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296192 00000100:00100000:3.0:1788970413.857270:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296192 00000100:00100000:3.0:1788970413.857320:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788970413.857328:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970413.857393:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102296192:12345-0@lo:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970413.857400:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:3.0:1788970413.857420:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970413.857451:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102296192:0@lo:400:kworker.0 00010000:00010000:3.0:1788970414.109619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970415.133647:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970415.226845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970415.226974:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328192 00000100:00100000:2.0:1788970415.226985:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328192 00000100:00100000:2.0:1788970415.227055:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 256 00000100:00100000:2.0:1788970415.227067:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:13163:x1875871082328192:12345-192.168.203.15@tcp:101:lsof.0 00010000:00010000:2.0:1788970415.227085:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970415.227114:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c6f910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db25 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970415.227195:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f917 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970415.227208:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970415.227219:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970415.227265:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970415.227268:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970415.227303:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970415.227326:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c6f910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db25 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970415.227344:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db25 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970415.227351:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:2.0:1788970415.227354:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970415.227358:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8800, rc 0) 00000100:00080000:3.0:1788970415.227467:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970415.227823:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:13163:x1875871082328192:12345-192.168.203.15@tcp:101:lsof.0 Request processed in 757us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970415.227831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 256 00000100:00100000:1.0:1788970415.388728:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102296448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970415.388797:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970415.388872:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970415.388879:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102296576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970415.388903:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970415.388980:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296448 00000100:00100000:2.0:1788970415.388990:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296448 00000100:00100000:2.0:1788970415.389065:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296576 00000100:00100000:2.0:1788970415.389069:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296576 00000100:00100000:2.0:1788970415.389094:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788970415.389111:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788970415.389114:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102296448:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970415.389127:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102296576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788970415.389151:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:2.0:1788970415.389151:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1788970415.389241:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970415.389285:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102296448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970415.389293:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788970415.394172:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102296576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5040us (5256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970415.394188:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788970415.394192:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102296576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970415.394234:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102296448:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788970415.904136:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788970415.904153:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788970415.904206:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788970415.904224:0:6556:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788970416.156619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970416.324666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.324709:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.324739:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.324783:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.324803:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.324819:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.324840:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970416.325089:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328448 00000100:00100000:3.0:1788970416.325108:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328448 00000100:00100000:2.0:1788970416.325245:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328960 00000100:00100000:2.0:1788970416.325250:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328960 00000100:00100000:2.0:1788970416.325295:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328576 00000100:00100000:2.0:1788970416.325298:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328576 00000100:00100000:1.0:1788970416.325333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328320 00000100:00100000:1.0:1788970416.325337:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328320 00000100:00100000:0.0:1788970416.325362:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328704 00000100:00100000:0.0:1788970416.325368:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328704 00000100:00100000:3.0:1788970416.325844:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082329088 00000100:00100000:3.0:1788970416.325848:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082329088 00000100:00100000:1.0:1788970416.325946:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 389 00000100:00100000:1.0:1788970416.325956:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082328320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970416.326069:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2401:x1875871082328320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 115us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970416.326077:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 389 00000100:00100000:1.0:1788970416.326117:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082328832 00000100:00100000:1.0:1788970416.326120:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082328832 00000100:00100000:2.0:1788970416.326308:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 337 00000100:00100000:2.0:1788970416.326315:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082328960:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970416.326353:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2401:x1875871082328960:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 39us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970416.326366:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 337 00000100:00100000:2.0:1788970416.326395:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 338 00000100:00100000:2.0:1788970416.326402:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2401:x1875871082328448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970416.326434:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+18:2401:x1875871082328448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 33us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970416.326438:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 338 00000100:00100000:2.0:1788970416.326450:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 339 00000100:00100000:2.0:1788970416.326456:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082328576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970416.326495:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082328576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 40us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970416.326500:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 339 00000100:00080000:2.0:1788970416.326696:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970416.326701:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970416.326704:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970416.326706:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970416.327722:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:0.0:1788970416.327806:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2401:x1875871082328704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970416.327837:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 340 00000100:00100000:3.0:1788970416.327849:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082329088:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970416.327870:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2401:x1875871082328704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 69us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970416.327888:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2401:x1875871082329088:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 41us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970416.327893:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:3.0:1788970416.327903:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 340 00000100:00100000:1.0:1788970416.328677:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:1.0:1788970416.328688:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082328832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970416.328731:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2401:x1875871082328832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 46us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970416.328738:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:1.0:1788970416.412669:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970416.412692:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102296704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970416.412773:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970416.417175:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296704 00000100:00100000:2.0:1788970416.417192:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296704 00000100:00100000:2.0:1788970416.417264:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788970416.417274:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102296704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970416.417310:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788970416.417918:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102296704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 644us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970416.417926:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788970416.417997:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102296704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970416.484992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970416.487901:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082329344 00000100:00100000:3.0:1788970416.487916:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082329344 00000100:00100000:3.0:1788970416.488047:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:3.0:1788970416.488059:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+18:13164:x1875871082329344:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:3.0:1788970416.488356:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+19:13164:x1875871082329344:12345-192.168.203.15@tcp:35:umount.0 Request processed in 298us (3373us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788970416.488363:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:1.0:1788970416.494749:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970416.498024:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082329600 00000100:00100000:2.0:1788970416.498042:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082329600 00000100:00100000:2.0:1788970416.498132:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:2.0:1788970416.498144:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+19:13164:x1875871082329600:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:2.0:1788970416.498476:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:13164:x1875871082329600:12345-192.168.203.15@tcp:35:umount.0 Request processed in 334us (3737us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788970416.498689:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:0.0:1788970416.501100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970416.501354:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082329856 00000100:00100000:2.0:1788970416.501365:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082329856 00000100:00100000:2.0:1788970416.501468:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:2.0:1788970416.501479:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb0e26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+20:13164:x1875871082329856:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:2.0:1788970416.502272:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb0e26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:13164:x1875871082329856:12345-192.168.203.15@tcp:35:umount.0 Request processed in 792us (1197us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788970416.502282:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:0.0:1788970416.516475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970416.516590:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082330112 00000100:00100000:3.0:1788970416.516600:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082330112 00000100:00100000:3.0:1788970416.516756:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1788970416.516767:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+21:13164:x1875871082330112:12345-192.168.203.15@tcp:35:umount.0 00000100:00100000:3.0:1788970416.517061:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+22:13164:x1875871082330112:12345-192.168.203.15@tcp:35:umount.0 Request processed in 296us (596us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788970416.517069:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:1.0:1788970416.530237:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.530329:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970416.530464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082330240 00000100:00100000:2.0:1788970416.530475:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082330240 00000100:00100000:1.0:1788970416.530478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970416.530671:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970416.530770:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082330496 00000100:00100000:0.0:1788970416.530776:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082330496 00000100:00100000:0.0:1788970416.530799:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082330368 00000100:00100000:0.0:1788970416.530802:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082330368 00000100:00100000:0.0:1788970416.530818:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970416.530828:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+15:2403:x1875871082330240:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970416.530845:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970416.530862:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654200/0xc3abfebe76c6e87e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d67f expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.530880:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970416.530943:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+14:2403:x1875871082330240:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 105us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970416.530952:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970416.530970:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1788970416.530976:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+13:2403:x1875871082330496:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970416.530984:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970416.530992:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6eb17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d758 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.531003:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970416.531019:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:2403:x1875871082330496:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 44us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970416.531044:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1788970416.531059:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970416.531065:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:2403:x1875871082330368:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970416.531073:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970416.531081:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6e83f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d640 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.531102:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970416.531122:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2403:x1875871082330368:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 56us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970416.531128:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1788970416.531700:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082330624 00000100:00100000:3.0:1788970416.531709:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082330624 00000100:00100000:3.0:1788970416.531756:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:3.0:1788970416.531765:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2399:x1875871082330624:12345-192.168.203.15@tcp:9:umount.0 00000020:00000080:3.0:1788970416.531792:0:8441:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6ec1a 00000100:00080000:3.0:1788970416.531802:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8a7d83d76800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970416.531845:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788970416.531851:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970416.532295:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+2:2399:x1875871082330624:12345-192.168.203.15@tcp:9:umount.0 Request processed in 529us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970416.532303:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 80 00000100:00100000:1.0:1788970416.536775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970416.536887:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082331008 00000100:00100000:0.0:1788970416.536897:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082331008 00000100:00100000:0.0:1788970416.537019:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 81 00000100:00100000:0.0:1788970416.537030:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+7:2399:x1875871082331008:12345-192.168.203.15@tcp:9:umount.0 00000020:00000080:0.0:1788970416.537061:0:10104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6ee90 00000020:00010000:0.0:1788970416.537070:0:10104:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7e844cc800: total 0 00000100:00080000:0.0:1788970416.537074:0:10104:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3ea000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970416.537136:0:10104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788970416.537320:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2399:x1875871082331008:12345-192.168.203.15@tcp:9:umount.0 Request processed in 291us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970416.537328:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 81 00000020:00010000:3.0:1788970416.537424:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7e844cc800: total 0 00010000:00010000:3.0:1788970416.537457:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7e844cc800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788970416.537501:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c6f248 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d942 expref: 4 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970416.537549:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6f909 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db1e expref: 3 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970416.537577:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7e844cc800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788970416.537589:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970416.537591:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970416.537592:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970416.548647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970416.548803:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332032 00000100:00100000:0.0:1788970416.548814:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332032 00000100:00100000:0.0:1788970416.548889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 257 00000100:00100000:0.0:1788970416.548900:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+22:2399:x1875871082332032:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:0.0:1788970416.548932:0:6525:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e84d 00000020:00010000:0.0:1788970416.548951:0:6525:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7d83527000: total 0 00000100:00080000:0.0:1788970416.548957:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970416.549031:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788970416.549249:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76727560-d4e0-4213-a4e0-b609fd69db0f+21:2399:x1875871082332032:12345-192.168.203.15@tcp:39:umount.0 Request processed in 342us (613us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788970416.549258:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 257 00000020:00010000:3.0:1788970416.549942:0:6513:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7d83527000: total 0 00010000:00010000:3.0:1788970416.549947:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970416.550261:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7d83527000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788970416.550296:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970416.550300:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970416.550307:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c6eeeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d85b expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.550325:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:0.0:1788970416.550327:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970416.550330:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c6f8ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db09 expref: 19 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.550342:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823e6200) 00010000:00010000:0.0:1788970416.550344:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970416.550347:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98600/0xc3abfebe76c6eb95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d76d expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.550365:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970416.551249:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970416.551259:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99400/0xc3abfebe76c6f209 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d92d expref: 17 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551282:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970416.551284:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788970416.551288:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c6f233 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d93b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551306:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970416.551308:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970416.551311:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98a00/0xc3abfebe76c6f5ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8da37 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551323:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:0.0:1788970416.551326:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970416.551329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c6f2a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d957 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551341:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:0.0:1788970416.551344:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788970416.551348:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655c00/0xc3abfebe76c6f8f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db17 expref: 13 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551360:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a7eb55b5b00) 00010000:00010000:0.0:1788970416.551362:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970416.551365:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98800/0xc3abfebe76c6f7ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dad1 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551600:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a7d8335f300) 00010000:00010000:0.0:1788970416.551603:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970416.551608:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99200/0xc3abfebe76c6f129 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d8f5 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551623:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7d83360700) 00010000:00010000:0.0:1788970416.551626:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970416.551629:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae012000/0xc3abfebe76c6eb79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d766 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551657:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a7e88bd6c00) 00010000:00010000:0.0:1788970416.551661:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788970416.551664:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eae013200/0xc3abfebe76c6f2bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d95e expref: 9 pid: 10102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551678:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a7d823e8000) 00010000:00010000:0.0:1788970416.551680:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788970416.551683:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c6ebf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d782 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970416.551695:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7d83527000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788970416.551727:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970416.551729:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970416.551731:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970416.559111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970416.559201:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332160 00000100:00100000:2.0:1788970416.559211:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332160 00000100:00100000:2.0:1788970416.559634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 258 00000100:00100000:2.0:1788970416.559647:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+5:2399:x1875871082332160:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:2.0:1788970416.559682:0:6524:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e854 00000100:00080000:2.0:1788970416.559944:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970416.559973:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788970416.560122:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970416.560280:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76727560-d4e0-4213-a4e0-b609fd69db0f+3:2399:x1875871082332160:12345-192.168.203.15@tcp:39:umount.0 Request processed in 636us (1187us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788970416.560289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 258 00010000:00010000:0.0:1788970417.180852:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970417.955923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102296832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970417.955994:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970417.956250:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296832 00000100:00100000:2.0:1788970417.956259:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296832 00000100:00100000:2.0:1788970417.956318:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788970417.956327:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102296832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970417.956359:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788970417.960610:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102296832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4271us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970417.960627:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788970417.967562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102296832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970418.047208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970418.047310:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970418.049705:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970418.052600:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970418.052645:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332800 00000100:00100000:3.0:1788970418.052655:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332800 00000100:00100000:3.0:1788970418.052781:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 259 00000100:00100000:3.0:1788970418.052792:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+6:2399:x1875871082332800:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:3.0:1788970418.052832:0:13652:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e965 00000020:00010000:3.0:1788970418.052841:0:13652:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7ebf3b3800: total 0 00000100:00080000:3.0:1788970418.052846:0:13652:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970418.052867:0:13652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788970418.053045:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2399:x1875871082332800:12345-192.168.203.15@tcp:39:umount.0 Request processed in 254us (456us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788970418.053053:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 259 00000020:00010000:3.0:1788970418.053096:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7ebf3b3800: total 0 00010000:00010000:3.0:1788970418.053151:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7ebf3b3800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788970418.053187:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d823ee200) 00010000:00010000:3.0:1788970418.053191:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970418.053199:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c6f917 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db25 expref: 4 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970418.053222:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7ebf3b3800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788970418.053234:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970418.053236:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970418.053237:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970418.053353:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970418.053758:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332288 00000100:00100000:0.0:1788970418.053767:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332288 00000100:00100000:0.0:1788970418.053822:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332416 00000100:00100000:0.0:1788970418.053825:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332416 00000100:00100000:0.0:1788970418.053838:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332544 00000100:00100000:0.0:1788970418.054000:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332544 00000100:00100000:0.0:1788970418.054027:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1788970418.054036:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+12:2402:x1875871082332288:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970418.054049:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970418.054062:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654c00/0xc3abfebe76c6e950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d694 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970418.054075:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970418.054123:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+11:2402:x1875871082332288:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 88us (6925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.054129:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1788970418.054146:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1788970418.054153:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+10:2402:x1875871082332416:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970418.054161:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970418.054170:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98400/0xc3abfebe76c6e957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d6c5 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970418.054178:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970418.054195:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+9:2402:x1875871082332416:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 44us (6886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.054201:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1788970418.054242:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:0.0:1788970418.054248:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+8:2403:x1875871082332544:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970418.054256:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970418.054272:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4600/0xc3abfebe76c6eb10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d751 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970418.054282:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970418.054302:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+7:2403:x1875871082332544:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 54us (4606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.054308:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1788970418.059940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970418.060191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082332928 00000100:00100000:2.0:1788970418.060203:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082332928 00000100:00100000:2.0:1788970418.060327:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00100000:2.0:1788970418.060337:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+5:2399:x1875871082332928:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:2.0:1788970418.060374:0:6526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e96c 00000100:00080000:2.0:1788970418.060420:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8a7d81a39800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970418.060442:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788970418.060589:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84179ff9-de03-4594-a7ab-22774d7b8d1d+3:2399:x1875871082332928:12345-192.168.203.15@tcp:39:umount.0 Request processed in 253us (658us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788970418.060597:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 260 00000100:00080000:3.0:1788970418.061799:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788970418.066116:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970418.102491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970418.102915:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333184 00000100:00100000:1.0:1788970418.102925:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333184 00000100:00100000:1.0:1788970418.102993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 390 00000100:00100000:1.0:1788970418.103003:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+7:2399:x1875871082333184:12345-192.168.203.15@tcp:251:umount.0 00000020:00000080:1.0:1788970418.103048:0:6518:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e82a 00000020:00010000:1.0:1788970418.103056:0:6518:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7d83523800: total 0 00000100:00080000:1.0:1788970418.103061:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8a7d83521800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788970418.103151:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaba251a-cf52-4613-ab47-fccc9a1d3dd9+3:2399:x1875871082333184:12345-192.168.203.15@tcp:251:umount.0 Request processed in 148us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970418.103158:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 390 00000020:00010000:3.0:1788970418.103565:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7d83523800: total 0 00010000:00010000:3.0:1788970418.103569:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970418.103619:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7d83523800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788970418.103650:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6e885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8d686 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970418.103664:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7d83523800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788970418.103675:0:6512:0:(genops.c:885:class_export_put()) final put ffff8a7d83523800/aaba251a-cf52-4613-ab47-fccc9a1d3dd9 00010000:00010000:3.0:1788970418.103691:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970418.103694:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970418.103695:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788970418.103738:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83523800/aaba251a-cf52-4613-ab47-fccc9a1d3dd9 for MGS 00000020:00000080:0.0:1788970418.103771:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83521800 for MGS 00010000:00010000:2.0:1788970418.204534:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970418.980728:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102296960:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.980791:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102297216:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.980798:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970418.980849:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102297600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970418.981187:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102297088:0@lo:400:kworker.0 00000100:00100000:3.0:1788970418.981280:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102297344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970418.981462:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970418.981497:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102297728:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.981521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970418.981538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102298240:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.981562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970418.981581:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102298752:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.981600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970418.981630:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298240 00000100:00100000:0.0:1788970418.981637:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298240 00000100:00100000:0.0:1788970418.981685:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298752 00000100:00100000:0.0:1788970418.981690:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298752 00000100:00100000:0.0:1788970418.981855:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788970418.981864:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102298240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.981917:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102298240:12345-0@lo:400:kworker.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.981923:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788970418.981938:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788970418.981954:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102298752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.981984:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102298752:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.981989:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1788970418.982005:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970418.982009:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970418.982041:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102298240:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.982051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102298752:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.982476:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297216 00000100:00100000:0.0:1788970418.982481:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297216 00000100:00100000:0.0:1788970418.982507:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297728 00000100:00100000:0.0:1788970418.982510:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297728 00000100:00100000:0.0:1788970418.982522:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788970418.982528:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102297216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.982571:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102297216:12345-0@lo:400:kworker.0 Request processed in 42us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.982577:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788970418.982589:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788970418.982595:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102297728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.982623:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102297728:12345-0@lo:400:kworker.0 Request processed in 28us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.982628:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788970418.982731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102296960 00000100:00100000:0.0:1788970418.982736:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102296960 00000100:00100000:0.0:1788970418.982763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788970418.982769:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102296960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.982810:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102296960:12345-0@lo:400:kworker.0 Request processed in 41us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.982816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788970418.982850:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102297728:0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.982859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102297216:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.983523:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970418.983525:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970418.983560:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102297472:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.983572:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102297984:0@lo:400:kworker.0 00000100:00100000:2.0:1788970418.983596:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970418.983630:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102298112:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.983640:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970418.983661:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970418.983666:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102298496:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.983695:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970418.983720:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102296960:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.983754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297088 00000100:00100000:1.0:1788970418.983759:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297088 00000100:00100000:1.0:1788970418.983785:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297472 00000100:00100000:1.0:1788970418.983788:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297472 00000100:00100000:1.0:1788970418.983801:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297984 00000100:00100000:1.0:1788970418.983803:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297984 00000100:00100000:0.0:1788970418.983822:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297600 00000100:00100000:1.0:1788970418.983826:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298496 00000100:00100000:0.0:1788970418.983829:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297600 00000100:00100000:1.0:1788970418.983831:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298496 00000100:00100000:1.0:1788970418.983865:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788970418.983873:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.983879:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788970418.983890:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102297600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970418.983915:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102297088:12345-0@lo:400:kworker.0 Request processed in 42us (393us total) trans 0 rc 0/0 00002000:00000024:0.0:1788970418.983917:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788970418.983926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788970418.983942:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788970418.983949:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102297472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.983968:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102297600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.983976:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788970418.983985:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102297472:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970418.983994:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788970418.984001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788970418.984014:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788970418.984015:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102297984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.984026:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102298496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.984060:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102297984:12345-0@lo:400:kworker.0 Request processed in 50us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970418.984070:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102298496:12345-0@lo:400:kworker.0 Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.984070:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788970418.984094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:1.0:1788970418.984124:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970418.984128:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970418.984134:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102298624:0@lo:400:kworker.0 00010000:00080000:1.0:1788970418.984147:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83568780 x1875871102297984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970418.984169:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970418.984176:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102297984:0@lo:400:kworker.0 00010000:00080000:1.0:1788970418.984192:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83e86580 x1875871102298496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970418.984202:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102298496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970418.984219:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102297088:0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.984223:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102297600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970418.984308:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298112 00000100:00100000:0.0:1788970418.984312:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298112 00000100:00100000:0.0:1788970418.984348:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298624 00000100:00100000:0.0:1788970418.984351:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298624 00000100:00100000:0.0:1788970418.984366:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970418.984373:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102298112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.984426:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102298112:12345-0@lo:400:kworker.0 Request processed in 53us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.984439:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970418.984451:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788970418.984457:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102298624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970418.984484:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102298624:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970418.984490:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788970418.984617:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102297472:0@lo:400:kworker.0 00000100:00100000:2.0:1788970418.984629:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102298112:0@lo:400:kworker.0 00000100:00100000:2.0:1788970418.984652:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102298624:0@lo:400:kworker.0 00000100:00080000:1.0:1788970418.985346:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970418.987359:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970418.987431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102297856:0@lo:400:kworker.0 00000100:00100000:3.0:1788970418.987486:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970418.987521:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102298368:0@lo:400:kworker.0 00000100:00100000:3.0:1788970418.987540:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970418.987661:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297344 00000100:00100000:2.0:1788970418.987670:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297344 00000100:00100000:2.0:1788970418.987721:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788970418.987729:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102297344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970418.987752:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970418.987799:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102297344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970418.987805:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788970418.987864:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102297856 00000100:00100000:1.0:1788970418.987868:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102297856 00000100:00100000:1.0:1788970418.987908:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298368 00000100:00100000:1.0:1788970418.987911:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298368 00000100:00100000:1.0:1788970418.987930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788970418.987937:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102297856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.987973:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102297856:12345-0@lo:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970418.987979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788970418.987993:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788970418.987999:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102298368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970418.988023:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102298368:12345-0@lo:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970418.988028:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:2.0:1788970418.988090:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970418.988164:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102297344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970418.988175:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102297856:0@lo:400:kworker.0 00000100:00100000:3.0:1788970418.988184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102298368:0@lo:400:kworker.0 00010000:00010000:3.0:1788970419.228561:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788970419.646099:0:15159:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788970419.656953:0:15159:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788970419.657019:0:15159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.657053:0:15159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.657061:0:15159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.657079:0:15159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.657107:0:15159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788970419.657114:0:15159:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788970419.657151:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788970419.657156:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788970419.657156:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788970419.657162:0:15159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788970419.657164:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970419.657171:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970419.657174:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970419.657182:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788970419.657187:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa736800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1788970419.657189:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970419.657206:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970419.657208:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788970419.657210:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788970419.657238:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970419.657245:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970419.657279:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970419.657287:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b400/0xc3abfebe76c6e8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970419.657299:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970419.657301:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970419.657303:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970419.657310:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970419.657331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102299008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970419.657363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102298880:0@lo:39:umount.0 00000100:00100000:3.0:1788970419.657422:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970419.657422:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970419.660671:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299008 00000100:00100000:0.0:1788970419.660685:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299008 00000100:00100000:0.0:1788970419.660741:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970419.660750:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3649:x1875871102299008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970419.660764:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970419.660783:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c6e8e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8e0 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970419.660798:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970419.660854:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+23:3649:x1875871102299008:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (3433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970419.660862:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970419.660889:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102298880 00000100:00100000:0.0:1788970419.660893:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102298880 00000100:00100000:0.0:1788970419.660927:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788970419.660935:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875871102298880:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788970419.660961:0:13652:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e441 00000100:00080000:0.0:1788970419.660969:0:13652:0:(import.c:65:import_set_state_nolock()) ffff8a7eab0ac000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788970419.661041:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1875871102298880:12345-0@lo:39:umount.0 Request processed in 107us (3620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970419.661048:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1788970419.661057:0:13652:0:(genops.c:885:class_export_put()) final put ffff8a7eaa79f000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788970419.661950:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788970419.662107:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaa79f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788970419.662163:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eab0ac000 for lustre-MDT0000 00000100:00080000:0.0:1788970419.662211:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa736800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788970419.662226:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102298880:0@lo:39:umount.0 00000100:00100000:3.0:1788970419.662478:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102299008:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788970419.666356:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970419.666364:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788970419.666371:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788970419.667421:0:15159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667437:0:15159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667446:0:15159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667453:0:15159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667492:0:15159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970419.667499:0:15159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667507:0:15159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667514:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970419.667514:0:15159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667527:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667528:0:15159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667549:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970419.667555:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667555:0:15159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970419.667565:0:15159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667569:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667575:0:15159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970419.667582:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667585:0:15159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970419.667597:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970419.667601:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788970419.667601:0:15159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667612:0:15159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970419.667617:0:15159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667630:0:15159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667635:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667637:0:15159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667653:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970419.667655:0:15159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970419.667667:0:15159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788970419.667671:0:15159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788970419.667676:0:15159:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788970419.667684:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788970419.667704:0:15159:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1788970419.667706:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013e00/0xc3abfebe76c6e8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8f5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788970419.667709:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788970419.667715:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970419.667722:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:2.0:1788970419.667728:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:1.0:1788970419.667730:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7d81a39000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788970419.667734:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.667740:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7eaec9a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970419.667750:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7eaec87800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970419.667754:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7ebbb18800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:2.0:1788970419.667760:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ae00 already unused, calling callback (ffffffffc116cc20) 00000020:00080000:1.0:1788970419.667762:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a7ebf3b3800 84179ff9-de03-4594-a7ab-22774d7b8d1d 192.168.203.15@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1788970419.667766:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.667771:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a7d83527000 76727560-d4e0-4213-a4e0-b609fd69db0f 192.168.203.15@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00010000:00010000:2.0:1788970419.667783:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.667784:0:15159:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8a7e84850000) has exports, disconnecting them 00000020:00080000:1.0:1788970419.667790:0:15159:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7d81a39000), last request at 1788970418 10000000:00010000:2.0:1788970419.667797:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788970419.667800:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e751 10000000:01000000:2.0:1788970419.667804:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970419.667809:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788970419.667812:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:1.0:1788970419.667826:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7d81a3c800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788970419.667831:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667838:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970419.667845:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667852:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ae00/0xc3abfebe76c6e7e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e7eb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.667872:0:15159:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d81a39000): rc 0 00010000:00010000:2.0:1788970419.667874:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1788970419.667876:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7d81a39000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788970419.667879:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.667887:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99e00 already unused, calling callback (ffffffffc116cc20) 00000020:00080000:1.0:1788970419.667889:0:15159:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7eaec9a800), last request at 1788970418 10000000:00010000:2.0:1788970419.667893:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788970419.667894:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e62b 00000100:00080000:1.0:1788970419.667901:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec9c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788970419.667904:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.667910:0:15159:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eaec9a800): rc 0 10000000:00010000:2.0:1788970419.667914:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788970419.667915:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eaec9a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788970419.667922:0:15159:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7eaec87800), last request at 1788970201 10000000:01000000:2.0:1788970419.667925:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:1.0:1788970419.667927:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e528 10000000:01000000:2.0:1788970419.667929:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788970419.667932:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:1.0:1788970419.667933:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec85800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788970419.667941:0:15159:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eaec87800): rc 0 00000020:00000080:1.0:1788970419.667943:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eaec87800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:2.0:1788970419.667949:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.667950:0:15159:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7ebbb18800), last request at 1788970201 00000020:00000080:1.0:1788970419.667955:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4e9 00000100:00080000:1.0:1788970419.667960:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7eae15a800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788970419.667962:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000001:00000004:1.0:1788970419.667967:0:15159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:2.0:1788970419.667991:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668000:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99e00/0xc3abfebe76c6eb48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6eb4f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668011:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970419.668013:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668024:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970419.668027:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668033:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970419.668039:0:15159:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7ebbb18800): rc 0 10000000:00010000:2.0:1788970419.668040:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970419.668048:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000004:00000080:1.0:1788970419.668048:0:15159:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa287c7b17ae0 10000000:01000000:2.0:1788970419.668052:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788970419.668057:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1788970419.668080:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788970419.668085:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788970419.668087:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668094:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970419.668100:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668105:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5200/0xc3abfebe76c6e3a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e3a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668116:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970419.668117:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970419.668119:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970419.668136:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102299136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970419.668207:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970419.668263:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970419.668276:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102299264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970419.668302:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970419.668344:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102299520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970419.668366:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970419.668709:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00000080:0.0:1788970419.668712:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a39000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788970419.668721:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102299392:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788970419.668765:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec9a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788970419.668786:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec87800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788970419.668803:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d81a3c800 for lustre-MDT0000 00000020:00000080:0.0:1788970419.668807:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaec9c000 for lustre-MDT0000 00000020:00000080:0.0:1788970419.668810:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaec85800 for lustre-MDT0000 00000100:00100000:0.0:1788970419.668825:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299136 00000100:00100000:0.0:1788970419.668832:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299136 00000100:00100000:2.0:1788970419.668868:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970419.668871:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299264 00000100:00100000:0.0:1788970419.668875:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299264 00000100:00100000:0.0:1788970419.668899:0:7932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299520 00000100:00100000:0.0:1788970419.668902:0:7932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299520 00000100:00100000:2.0:1788970419.668908:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299392 00000100:00100000:2.0:1788970419.668915:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299392 00000100:00100000:0.0:1788970419.668925:0:7932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788970419.668936:0:15159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788970419.668937:0:7932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3651:x1875871102299136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970419.668947:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788970419.668949:0:7932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1788970419.668951:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7eaed79800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788970419.668958:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+26:3651:x1875871102299264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970419.668968:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99600/0xc3abfebe76c6e8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8ee expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.668969:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970419.668984:0:7932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970419.668987:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c6e7eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e7e4 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.669001:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970419.669029:0:7932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102299136:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970419.669039:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+24:3651:x1875871102299264:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970419.669049:0:7932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970419.669234:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788970419.669254:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970419.669264:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+22:3650:x1875871102299520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970419.669273:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970419.669284:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80031000/0xc3abfebe76c6e3a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e3a0 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970419.669295:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970419.669326:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3650:x1875871102299520:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (959us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970419.670085:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970419.670107:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970419.670118:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+21:3650:x1875871102299392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970419.670131:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970419.670144:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c6eb4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6eb48 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970419.670155:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970419.670190:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fe147a8-4210-48cf-8358-c541b06e4cd0+20:3650:x1875871102299392:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970419.670198:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788970419.670236:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970419.670284:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102299392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970419.670297:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5fe147a8-4210-48cf-8358-c541b06e4cd0:3650:1875871102299520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970419.670474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102299648:0@lo:39:umount.0 00000100:00100000:0.0:1788970419.670511:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970419.670565:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102299264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970419.670578:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102299136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970419.670585:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299648 00000100:00100000:2.0:1788970419.670593:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299648 00000100:00100000:2.0:1788970419.670643:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788970419.670651:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875871102299648:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788970419.670676:0:6529:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e583 00000100:00080000:2.0:1788970419.670686:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbb1e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970419.670713:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788970419.670868:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3648:x1875871102299648:12345-0@lo:39:umount.0 Request processed in 218us (356us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788970419.670876:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1788970419.670942:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaed79800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788970419.670949:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102299648:0@lo:39:umount.0 00010000:00010000:3.0:1788970419.672333:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970419.673026:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788970419.673030:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788970419.673056:0:15159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788970419.673129:0:15159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788970419.673157:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7d824ff000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788970419.673177:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788970419.673377:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788970419.673410:0:15159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788970419.673487:0:15159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788970419.673496:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7d835f8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788970419.673526:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a7e84850000) has no exports 00000100:00100000:2.0:1788970419.674145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102299776:0@lo:9:umount.0 00000100:00100000:2.0:1788970419.674216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970419.674261:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102299904:0@lo:9:umount.0 00000100:00100000:2.0:1788970419.674285:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970419.674534:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299776 00000100:00100000:1.0:1788970419.674541:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299776 00000100:00100000:1.0:1788970419.674575:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102299904 00000100:00100000:1.0:1788970419.674577:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102299904 00000100:00100000:1.0:1788970419.674594:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970419.674601:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875871102299776:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788970419.674632:0:8689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e6d3 00000100:00080000:1.0:1788970419.674640:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d81acb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788970419.674676:0:8689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788970419.674783:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3648:x1875871102299776:12345-0@lo:9:umount.0 Request processed in 182us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970419.674790:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970419.674803:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788970419.674808:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875871102299904:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788970419.674817:0:8689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e823 00000100:00080000:1.0:1788970419.674822:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d835fc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788970419.674841:0:8689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788970419.674896:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3648:x1875871102299904:12345-0@lo:9:umount.0 Request processed in 88us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970419.674901:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788970419.674933:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d824ff000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788970419.674938:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788970419.674940:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970419.674943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102299776:0@lo:9:umount.0 00000100:00080000:1.0:1788970419.674962:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d835f8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788970419.674983:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788970419.674984:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970419.674987:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102299904:0@lo:9:umount.0 00010000:00010000:0.0:1788970419.677581:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970419.677931:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788970419.689476:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a7e84850000) has no exports 00000020:00000080:1.0:1788970419.775785:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e3fb 00000020:00000080:1.0:1788970419.775853:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7ebb916000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788970419.775922:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788970419.776123:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebb916000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788970419.776148:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970419.776158:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970419.776163:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8a7e8fc819c0) has no exports 00000020:00000080:0.0:1788970419.776895:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e3f4 00000020:00000080:0.0:1788970419.776903:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eab0a8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788970419.777055:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eab0a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788970419.777140:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970419.777149:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788970419.777151:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eab0ab000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788970419.777154:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eab0ab000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788970419.777159:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788970420.252870:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970420.508946:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102300032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970420.509026:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970420.509455:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300032 00000100:00100000:1.0:1788970420.509463:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300032 00000100:00100000:1.0:1788970420.509526:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788970420.509537:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102300032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970420.509566:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788970420.509625:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102300032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970420.509632:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788970420.509687:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102300032:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788970420.509910:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788970421.278102:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970421.341465:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970421.534484:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970421.534507:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102300160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970421.534569:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970421.534734:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300160 00000100:00100000:2.0:1788970421.534742:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300160 00000100:00100000:2.0:1788970421.534783:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788970421.534791:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875871102300160:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788970421.534799:0:7833:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788970421.534845:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875871102300160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (275us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788970421.534869:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:02020000:1.0:1788970421.534934:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788970421.538051:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788970421.538275:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788970421.538281:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788970421.555637:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970421.555652:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 220 00000100:00080000:1.0:1788970421.555748:0:3651:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7eb55d6800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970421.555820:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ed83c0 x1875871102300288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970421.559678:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102300288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788970421.559759:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970421.559875:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300288 00000100:00100000:0.0:1788970421.559884:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300288 00000100:00100000:0.0:1788970421.559926:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788970421.559946:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102300288:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788970421.559988:0:6529:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788970421.572128:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102300288:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 12172us (12360us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970421.572143:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1788970421.574128:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970421.574139:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970421.574145:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102300288:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788970422.300910:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788970422.560126:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788970422.560137:0:8435:0:(genops.c:885:class_export_put()) final put ffff8a7d81ac8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788970422.560169:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:2.0:1788970422.560173:0:8435:0:(genops.c:885:class_export_put()) final put ffff8a7e844cc800/76727560-d4e0-4213-a4e0-b609fd69db0f 00000001:00100000:0.0:1788970422.560193:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788970422.560198:0:9519:0:(genops.c:885:class_export_put()) final put ffff8a7d835fe000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788970422.560209:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:0.0:1788970422.560211:0:9519:0:(genops.c:885:class_export_put()) final put ffff8a7d83d73800/76727560-d4e0-4213-a4e0-b609fd69db0f 00000001:00100000:3.0:1788970422.560549:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970422.560554:0:6503:0:(genops.c:885:class_export_put()) final put ffff8a7ebbb18800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788970422.560561:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00080000:3.0:1788970422.560568:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788970422.560571:0:6503:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3b3800/84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00100000:3.0:1788970422.560575:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000001:00080000:3.0:1788970422.560580:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788970422.560587:0:6503:0:(genops.c:885:class_export_put()) final put ffff8a7d83527000/76727560-d4e0-4213-a4e0-b609fd69db0f 00000001:00100000:0.0:1788970422.560725:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788970422.560732:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788970422.560735:0:7456:0:(genops.c:885:class_export_put()) final put ffff8a7eb55d4800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788970422.560740:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00080000:0.0:1788970422.560745:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788970422.560747:0:7456:0:(genops.c:885:class_export_put()) final put ffff8a7d81a3a000/84179ff9-de03-4594-a7ab-22774d7b8d1d 00000001:00100000:0.0:1788970422.560763:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 76727560-d4e0-4213-a4e0-b609fd69db0f 00000001:00080000:0.0:1788970422.560766:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788970422.560768:0:7456:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3b4800/76727560-d4e0-4213-a4e0-b609fd69db0f 00000020:00000080:1.0:1788970422.563587:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81ac8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788970422.563665:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e844cc800/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-OST0000 00000020:00000080:1.0:1788970422.563686:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d835fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788970422.563708:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83d73800/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-OST0001 00000020:00000080:1.0:1788970422.563726:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebbb18800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788970422.563753:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3b3800/84179ff9-de03-4594-a7ab-22774d7b8d1d for lustre-MDT0000 00000020:00000080:1.0:1788970422.563775:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83527000/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-MDT0000 00000020:00000080:1.0:1788970422.563803:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb55d4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788970422.563877:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a3a000/84179ff9-de03-4594-a7ab-22774d7b8d1d for lustre-MDT0001 00000020:00000080:1.0:1788970422.563898:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3b4800/76727560-d4e0-4213-a4e0-b609fd69db0f for lustre-MDT0001 00000020:00000080:1.0:1788970422.563919:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d81acb000 for lustre-OST0000 00000020:00000080:1.0:1788970422.563926:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3ea000 for lustre-OST0000 00000020:00000080:1.0:1788970422.563930:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d835fc000 for lustre-OST0001 00000020:00000080:1.0:1788970422.563934:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83d76800 for lustre-OST0001 00000020:00000080:1.0:1788970422.563938:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eae15a800 for lustre-MDT0000 00000020:00000080:1.0:1788970422.563941:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b6800 for lustre-MDT0000 00000020:00000080:1.0:1788970422.563944:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b1000 for lustre-MDT0000 00000020:00000080:1.0:1788970422.563947:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebbb1e800 for lustre-MDT0001 00000020:00000080:1.0:1788970422.563950:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d81a39800 for lustre-MDT0001 00000020:00000080:1.0:1788970422.563952:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b1800 for lustre-MDT0001 00010000:00010000:0.0:1788970423.325605:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970424.092994:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102300416:0@lo:400:kworker.0 00000100:00100000:3.0:1788970424.093077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970424.093133:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970424.093151:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102300544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970424.093176:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970424.093218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300416 00000100:00100000:3.0:1788970424.093226:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300416 00000100:00100000:3.0:1788970424.093265:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788970424.093273:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3649:x1875871102300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970424.093315:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb3e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe147a8-4210-48cf-8358-c541b06e4cd0+19:3649:x1875871102300416:12345-0@lo:400:kworker.0 Request processed in 43us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970424.093322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788970424.093368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102300416:0@lo:400:kworker.0 00000100:00100000:3.0:1788970424.093408:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300544 00000100:00100000:3.0:1788970424.093411:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300544 00000100:00100000:3.0:1788970424.093442:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788970424.093447:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102300544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788970424.093468:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788970424.093513:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102300544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970424.093519:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788970424.093533:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970424.093554:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102300544:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788970424.094655:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970424.094663:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970424.094666:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970424.094683:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1788970424.094688:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970424.094697:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7eb55d6800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970424.094727:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83edbc00 x1875871102300672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970424.094832:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102300928:0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.094918:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970424.094946:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102301440:0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.094967:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970424.094992:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788970424.094998:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102300800:0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.095020:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970424.095051:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102301312:0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.095072:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970424.095100:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300928 00000100:00100000:1.0:1788970424.095106:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300928 00000100:00100000:1.0:1788970424.095132:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301440 00000100:00100000:1.0:1788970424.095134:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301440 00000100:00100000:1.0:1788970424.095157:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300800 00000100:00100000:1.0:1788970424.095159:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300800 00000100:00100000:1.0:1788970424.095168:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301312 00000100:00100000:1.0:1788970424.095170:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301312 00000100:00100000:1.0:1788970424.095181:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788970424.095189:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102301440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.095234:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102301440:12345-0@lo:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970424.095241:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788970424.095250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102300672:0@lo:38:kworker.0 00000100:00100000:1.0:1788970424.095271:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788970424.095277:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875871102300928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970424.095292:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788970424.095350:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788970424.095442:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788970424.095443:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102301056:0@lo:400:kworker.0 00000100:00100000:2.0:1788970424.095454:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1875871102300800:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788970424.095460:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788970424.095479:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970424.095499:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970424.095503:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1875871102300800:12345-0@lo:400:kworker.0 Request processed in 48us (480us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970424.095508:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102301184:0@lo:400:kworker.0 00000100:00100000:2.0:1788970424.095523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788970424.095531:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970424.095543:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301056 00000100:00100000:2.0:1788970424.095549:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301056 00000100:00100000:2.0:1788970424.095578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788970424.095585:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788970424.095588:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102301056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.095591:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875871102300928:12345-0@lo:400:kworker.0 Request processed in 103us (462us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970424.095597:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875871102301312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970424.095606:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00080000:3.0:1788970424.095607:0:10102:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788970424.095635:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875871102301312:12345-0@lo:400:kworker.0 Request processed in 40us (562us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970424.095642:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1788970424.095648:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788970424.095653:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7eae08d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788970424.095657:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788970424.095669:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301184 00000100:00100000:3.0:1788970424.095674:0:10104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301184 00000100:00100000:3.0:1788970424.095701:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788970424.095708:0:10104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970424.095739:0:10104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102301184:12345-0@lo:400:kworker.0 Request processed in 32us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970424.095745:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788970424.095769:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102301184:0@lo:400:kworker.0 00000100:00080000:3.0:1788970424.095792:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970424.095796:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970424.096450:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102300672 00000100:00100000:0.0:1788970424.096457:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102300672 00000100:00100000:0.0:1788970424.096492:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788970424.096498:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102300672:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788970424.096511:0:6530:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788970424.097268:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102301056:12345-0@lo:400:kworker.0 Request processed in 1679us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970424.097278:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00080000:3.0:1788970424.097300:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ed8000 x1875871102301056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970424.097324:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102301056:0@lo:400:kworker.0 00000100:00080000:1.0:1788970424.117553:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7eae08d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970424.117571:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 220 00000100:00080000:1.0:1788970424.117591:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a7eae08d800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970424.117645:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83fef0c0 x1875871102301568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970424.117682:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102300800:0@lo:400:kworker.0 00000100:00080000:1.0:1788970424.117717:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788970424.117721:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788970424.117724:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788970424.117728:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970424.117733:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 261 00000100:00080000:1.0:1788970424.117739:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7d82791800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970424.117747:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102301568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788970424.117757:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83fec780 x1875871102301696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970424.117769:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102301312:0@lo:400:kworker.0 00000100:00080000:1.0:1788970424.117801:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788970424.117805:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788970424.117809:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788970424.117812:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970424.117818:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 241 00000100:00100000:2.0:1788970424.117822:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788970424.117827:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7d82192800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970424.117841:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83feed00 x1875871102301824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970424.117850:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102300928:0@lo:400:kworker.0 00010000:00080000:1.0:1788970424.117871:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83eda580 x1875871102301440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970424.117882:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102301440:0@lo:400:kworker.0 00000100:00100000:2.0:1788970424.117887:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102301696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788970424.117913:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970424.117932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83feed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102301824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788970424.117949:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970424.117988:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301568 00000100:00100000:2.0:1788970424.117995:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301568 00000100:00100000:2.0:1788970424.118024:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301696 00000100:00100000:2.0:1788970424.118026:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301696 00000100:00100000:2.0:1788970424.118049:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301824 00000100:00100000:2.0:1788970424.118053:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301824 00000100:00100000:2.0:1788970424.118068:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788970424.118077:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102301568:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788970424.118098:0:10102:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788970424.118143:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102301568:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 66us (325us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788970424.118149:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788970424.118165:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788970424.118168:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102301696:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788970424.118174:0:10102:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788970424.118195:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102301696:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 25us (282us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788970424.118201:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788970424.118212:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788970424.118216:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102301824:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788970424.118222:0:10102:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788970424.118255:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102301824:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 38us (305us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788970424.118262:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788970424.118294:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970424.118298:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970424.118301:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102301696:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788970424.118308:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970424.118311:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970424.118313:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83feed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102301824:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788970424.118320:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eae08d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970424.118323:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970424.118325:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102301568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788970424.132178:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102300672:12345-0@lo:38:kworker.0 Request processed in 35668us (36875us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970424.132196:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:0.0:1788970424.136013:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970424.136025:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970424.136030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102300672:0@lo:38:kworker.0 00010000:00010000:3.0:1788970424.348803:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970425.375357:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970425.628704:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102301952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970425.628900:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970425.629049:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102301952 00000100:00100000:2.0:1788970425.629066:0:13816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102301952 00000100:00100000:2.0:1788970425.629119:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788970425.629129:0:13816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102301952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970425.629159:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788970425.629211:0:13816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102301952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970425.629218:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788970425.629365:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102301952:0@lo:13:osp-pre-0-1.0 00000020:01000000:0.0:1788970425.820594:0:15159:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e90b45720 - data ffff8a7eb12fc288/ffff8a7eaed73c00 00000020:01000000:0.0:1788970425.820765:0:15159:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7ea762d780 - data ffff8a7eb113e510/ffff8a7ebb8e4c00 00000001:00000004:0.0:1788970425.832681:0:15159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788970425.943510:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970425.943521:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788970425.943539:0:15159:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a7d83eda1c0 x1875871102299648/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788970429 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970425.943568:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788970425.949251:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788970425.949260:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788970425.949443:0:15159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970425.949447:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788970425.958965:0:8686:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788970425.958974:0:8686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788970425.958990:0:8686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788970425.960071:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788970425.960077:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788970425.960101:0:15159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970425.960104:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788970425.961031:0:9970:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788970425.961037:0:9970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788970425.961052:0:9970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788970425.963515:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e3c3 00000020:00000080:3.0:1788970425.963531:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0075800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788970425.967530:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0075800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788970425.970765:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e3d8 00000020:00000080:3.0:1788970425.970781:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c84000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788970425.970800:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788970425.970806:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970425.970813:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788970425.970830:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8a7e84853380) has no exports 00000020:00000080:1.0:1788970425.972087:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c84000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788970425.972305:0:15159:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788970425.972316:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e80e 00000020:00000080:3.0:1788970425.972324:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7d83520000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788970425.973587:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788970425.973601:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970425.973617:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788970425.973622:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8a7eae0919c0) has no exports 00000020:00000080:3.0:1788970425.973642:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e807 00000020:00000080:3.0:1788970425.973650:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7d835ff800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788970425.975590:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83520000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788970425.981598:0:15159:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788970425.981608:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788970425.981614:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788970425.981622:0:15159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970425.981624:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970425.984896:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d835ff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970425.986453:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d835f8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788970425.986547:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970425.986565:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970425.986571:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7d81a38000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970425.986575:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a38000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788970425.986585:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970425.986696:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e6cc 00000020:00000080:3.0:1788970425.986704:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7d824fd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788970425.986719:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788970425.986723:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970425.986730:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788970425.986734:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8a7d81aeb380) has no exports 00000020:00000080:3.0:1788970425.986740:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e6c5 00000020:00000080:3.0:1788970425.986744:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7d824f8800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788970425.987102:0:15159:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788970425.987107:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788970425.987111:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788970425.987123:0:15159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970425.987126:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970425.987158:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970425.987164:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788970425.987179:0:15159:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788970425.987186:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e57c 00000020:00000080:3.0:1788970425.987231:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eaec81000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788970425.987236:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788970425.987240:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970425.987244:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788970425.987247:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a7eae154d40) has no exports 00000020:00000080:3.0:1788970425.987251:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e575 00000020:00000080:3.0:1788970425.987254:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eaed7f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788970425.988585:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d824fd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788970425.988598:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d824f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970425.988613:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d824ff000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788970425.988619:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7d824fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970425.988620:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d824fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788970425.988624:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970425.988699:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec81000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788970425.988704:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaed7f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788970426.002596:0:15159:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788970426.002606:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970426.002611:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788970426.002620:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970426.002684:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970426.002699:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970426.002741:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970426.002744:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970426.002756:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0074000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970426.002761:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0074000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788970426.002770:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970426.002872:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e3df 00000020:00000080:3.0:1788970426.002880:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c82800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788970426.002886:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788970426.002889:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970426.002894:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788970426.002898:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8a7e84854d40) has no exports 00000020:00000080:3.0:1788970426.002916:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970426.002992:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaed79800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788970426.003004:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7eaec9b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970426.003006:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec9b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788970426.003013:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970426.003078:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c82800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788970426.003796:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788970426.003817:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0070000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788970426.003821:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0070000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788970426.003827:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788970426.003877:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e3e6 00000020:00000080:3.0:1788970426.003884:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c83000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788970426.003902:0:15159:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eb0d2c000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788970426.003906:0:15159:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0d2c000 3 00000020:01000004:3.0:1788970426.003908:0:15159:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7eb0d2c000 from lustre-MDT0000 00000020:00000080:3.0:1788970426.003931:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970426.003937:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788970426.003940:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0075000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788970426.003942:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0075000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788970426.003950:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788970426.003977:0:15159:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788970426.003981:0:15159:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788970426.003985:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788970426.003989:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970426.003992:0:15159:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788970426.003998:0:15159:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8a7eb0c26800 5fe147a8-4210-48cf-8358-c541b06e4cd0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970426.004004:0:15159:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8a7e8fc84d40) has exports, disconnecting them 00000020:00080000:3.0:1788970426.004009:0:15159:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a7eb0c26800), last request at 1788970182 00000020:00000080:3.0:1788970426.004034:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e384 00000020:00010000:3.0:1788970426.004039:0:15159:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7eb0c26800: total 1 00000100:00080000:3.0:1788970426.004043:0:15159:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c25000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788970426.004058:0:15159:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eb0c26800): rc 0 00000020:00080000:3.0:1788970426.004062:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8a7e8fc84d40) has no exports 00000020:00010000:3.0:1788970426.004078:0:6512:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7eb0c26800: total 1 00010000:00010000:3.0:1788970426.004101:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7eb0c26800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788970426.004133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c6e8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8d2 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004163:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e81535600/0xc3abfebe76c6e48e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e487 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004178:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c6eb25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6eb1e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004189:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99a00/0xc3abfebe76c6e903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8fc expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004198:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6e893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e88c expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004208:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c6eb41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6eb3a expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004217:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7e80031600/0xc3abfebe76c6e7a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e79e expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004229:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6eb33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6eb2c expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004243:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c6e8a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e89a expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004251:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b800/0xc3abfebe76c6e8af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8a8 expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004259:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae013c00/0xc3abfebe76c6e8bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8b6 expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004281:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c6e8cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e8c4 expref: 3 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004292:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec215a000/0xc3abfebe76c6e480 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6e479 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970426.004304:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7eb0c26800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788970426.004317:0:6512:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c26800/5fe147a8-4210-48cf-8358-c541b06e4cd0 00010000:00010000:3.0:1788970426.004323:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970426.004324:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970426.004326:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970426.004452:0:6518:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a7e91b7a600:6518] 2 exiting: rc = 0 00000020:00000080:1.0:1788970426.004534:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c83000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970426.004541:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c26800/5fe147a8-4210-48cf-8358-c541b06e4cd0 for MGS 00000020:00000080:1.0:1788970426.004570:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb0c25000 for MGS 00000100:00100000:3.0:1788970426.005933:0:6517:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a7e91b7b200:6517] 1 exiting: rc = 0 00000100:00100000:0.0:1788970426.016604:0:6516:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a7e92e8a000:6516] 0 exiting: rc = 1 00000100:00100000:3.0:1788970426.018673:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018694:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018702:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018707:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018712:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018718:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018723:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018729:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018735:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018742:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018748:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018753:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018758:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018764:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018769:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018776:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018788:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018794:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018802:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018824:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018830:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018836:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018841:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018847:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018853:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018858:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018865:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018869:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018875:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018882:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018887:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018892:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018897:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018903:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018909:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018915:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018920:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018926:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018931:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018936:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018941:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018945:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018950:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018955:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018959:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018964:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018968:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018973:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018979:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018983:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018988:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018992:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.018998:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019002:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019015:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019031:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019038:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019043:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019049:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019054:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019059:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019066:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019072:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970426.019078:0:15159:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788970426.022370:0:15159:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e90b450c0 - data ffff8a7d81cb65e8/ffff8a7d83242800 00000020:01000000:3.0:1788970426.023625:0:15159:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7ea762d1e0 - data ffff8a7eb1049438/ffff8a7eb0cb8800 00000020:00000080:3.0:1788970426.024099:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e368 00000020:00000080:3.0:1788970426.024107:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0ea5000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788970426.024130:0:15159:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eb0d2c000 from MGS, refs=2 00000020:01000004:3.0:1788970426.024133:0:15159:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0d2c000 2 00000020:01000004:3.0:1788970426.024136:0:15159:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7eb0d2c000 from MGS 00000020:00000080:3.0:1788970426.024159:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970426.024165:0:15159:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788970426.024168:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0ea3000/MGS 00000020:00000080:3.0:1788970426.024171:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0ea3000/MGS for MGS 00000020:01000000:3.0:1788970426.024177:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788970426.024243:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788970426.024247:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970426.024252:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788970426.024260:0:15159:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a7ebb89b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970426.024265:0:15159:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8a7e88288000) has exports, disconnecting them 00000020:00080000:3.0:1788970426.024269:0:15159:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a7ebb89b800), last request at 1788970183 00000020:00000080:3.0:1788970426.024273:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e433 00000020:00080000:3.0:1788970426.024283:0:15159:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7ebb89b800): rc 0 00000020:00000080:3.0:1788970426.024287:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7ebb89b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788970426.024461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0ea5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970426.024470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebb89b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788970426.061693:0:15159:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788970426.061702:0:15159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970426.061707:0:15159:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788970426.061714:0:15159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970426.061755:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaa736800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788970426.061936:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970426.061944:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788970426.061949:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7ebb89a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788970426.061952:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebb89a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788970426.061958:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788970426.062056:0:15159:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0d2c000 1 00000020:00000080:1.0:1788970426.062062:0:15159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e35a 00000020:00000080:1.0:1788970426.062068:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0ea2800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788970426.062076:0:15159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788970426.062365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0ea2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970426.062395:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970426.062400:0:15159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788970426.062404:0:15159:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8a7eb3dc19c0) has no exports 00000020:00000080:1.0:1788970426.196251:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970426.196265:0:15159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788970426.196271:0:15159:0:(genops.c:885:class_export_put()) final put ffff8a7eb0d2a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788970426.196276:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0d2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788970426.196284:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788970426.196457:0:15159:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7eb0d28800 00000020:02000400:1.0:1788970426.196519:0:15159:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788970426.396491:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970427.428890:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970428.449558:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970429.213040:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970429.213048:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970429.213051:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970429.213059:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788970429.213065:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788970429.213077:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7eb55d6800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970429.213100:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83fecf00 x1875871102302208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970429.213125:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970429.213129:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970429.213131:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7eae08d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970429.213134:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788970429.213137:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970429.213155:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a7eae08d800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970429.213168:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83fee1c0 x1875871102302336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970429.213178:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970429.213181:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970429.213183:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970429.213186:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788970429.213188:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970429.213192:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7d82192800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970429.213202:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83fef480 x1875871102302464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970429.213232:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970429.213235:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970429.213237:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970429.213240:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788970429.213243:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970429.213247:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7d82791800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970429.213256:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83fed2c0 x1875871102302848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970429.213296:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83feda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102302720:0@lo:400:kworker.0 00000100:00100000:1.0:1788970429.213358:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.213442:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970429.213449:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102302592:0@lo:400:kworker.0 00000100:00100000:1.0:1788970429.213474:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.213518:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302720 00000100:00100000:1.0:1788970429.213526:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302720 00000100:00100000:1.0:1788970429.213613:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788970429.213624:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102302720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970429.213677:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102302720:12345-0@lo:400:kworker.0 Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970429.213685:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788970429.213751:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83feda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102302720:0@lo:400:kworker.0 00000100:00100000:1.0:1788970429.213788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102302208:0@lo:38:kworker.0 00000100:00100000:1.0:1788970429.215057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.215097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102302336:0@lo:38:kworker.0 00000100:00100000:1.0:1788970429.215137:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.215153:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102302464:0@lo:38:kworker.0 00000100:00100000:1.0:1788970429.215171:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.215195:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102302848:0@lo:38:kworker.0 00000100:00100000:1.0:1788970429.215215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.215258:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302592 00000100:00100000:1.0:1788970429.215264:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302592 00000100:00100000:1.0:1788970429.215299:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302336 00000100:00100000:1.0:1788970429.215301:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302336 00000100:00100000:1.0:1788970429.215310:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302464 00000100:00100000:1.0:1788970429.215312:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302464 00000100:00100000:1.0:1788970429.215319:0:13652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302848 00000100:00100000:1.0:1788970429.215321:0:13652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302848 00000100:00100000:1.0:1788970429.215332:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788970429.215341:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102302592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970429.215400:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102302592:12345-0@lo:400:kworker.0 Request processed in 61us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970429.215420:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788970429.215437:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788970429.215441:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875871102302336:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788970429.215461:0:13652:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788970429.215491:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875871102302336:12345-0@lo:38:kworker.0 Request processed in 48us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970429.215496:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788970429.215511:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788970429.215515:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875871102302464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788970429.215523:0:13652:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788970429.215543:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875871102302464:12345-0@lo:38:kworker.0 Request processed in 27us (371us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970429.215547:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788970429.215556:0:13652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788970429.215560:0:13652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875871102302848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788970429.215566:0:13652:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788970429.215583:0:13652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875871102302848:12345-0@lo:38:kworker.0 Request processed in 23us (368us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970429.215588:0:13652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00080000:1.0:1788970429.215621:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a7d83fef840 x1875871102302592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970429.215633:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102302592:0@lo:400:kworker.0 00000100:00080000:1.0:1788970429.215659:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eae08d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970429.215670:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970429.215673:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102302336:0@lo:38:kworker.0 00000100:00080000:1.0:1788970429.215684:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970429.215687:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970429.215689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102302464:0@lo:38:kworker.0 00000100:00080000:1.0:1788970429.215696:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970429.215699:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970429.215701:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102302848:0@lo:38:kworker.0 00000100:00100000:2.0:1788970429.215842:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102302976:0@lo:400:kworker.0 00000100:00100000:2.0:1788970429.215875:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970429.215905:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788970429.215919:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102302080:0@lo:400:kworker.0 00000400:00000100:2.0:1788970429.215939:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102302080 offset 0 length 224: 4 00000100:00100000:2.0:1788970429.215957:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102303104:0@lo:400:kworker.0 00000100:00100000:2.0:1788970429.215977:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970429.216025:0:10102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302976 00000100:00100000:2.0:1788970429.216028:0:10102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302976 00000100:00100000:2.0:1788970429.216054:0:10102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788970429.216060:0:10102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102302976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970429.216094:0:10102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102302976:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970429.216100:0:10102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788970429.216125:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303104 00000100:00100000:2.0:1788970429.216128:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303104 00000100:00100000:2.0:1788970429.216155:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788970429.216162:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102303104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970429.216192:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102303104:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970429.216199:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788970429.216223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102303104:0@lo:400:kworker.0 00010000:00080000:2.0:1788970429.216232:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a7d83fec000 x1875871102302976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970429.216241:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102302976:0@lo:400:kworker.0 00000100:00080000:3.0:1788970429.216860:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970429.216867:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970429.216869:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970429.216882:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102302208 00000100:00100000:3.0:1788970429.216888:0:7833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102302208 00000100:00100000:3.0:1788970429.216914:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788970429.216930:0:7833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102302208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788970429.216946:0:7833:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970429.216990:0:7833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102302208:12345-0@lo:38:kworker.0 Request processed in 60us (1938us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970429.216997:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1788970429.217045:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970429.217049:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788970429.217053:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102302208:0@lo:38:kworker.0 00000100:00100000:2.0:1788970429.217476:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970429.217488:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102303232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970429.217553:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970429.217599:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303232 00000100:00100000:2.0:1788970429.217604:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303232 00000100:00100000:2.0:1788970429.217634:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788970429.217640:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102303232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970429.217663:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788970429.217696:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102303232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970429.217702:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788970429.217733:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102303232:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788970429.471545:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970429.766878:0:15361:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788970429.795874:0:15361:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788970429.795932:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.795948:0:15361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.795955:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.795963:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.795983:0:15361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788970429.795988:0:15361:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788970429.796022:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970429.796027:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788970429.796035:0:15361:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788970429.796041:0:15361:0:(import.c:65:import_set_state_nolock()) ffff8a7eae08d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788970429.796059:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970429.796061:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788970429.796064:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788970429.796430:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970429.796438:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970429.796446:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970429.796450:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970429.796459:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970429.796467:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970429.796486:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970429.796488:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788970429.796491:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788970429.796532:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970429.796539:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970429.796564:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970429.796571:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae012e00/0xc3abfebe76c6e8c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970429.796584:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970429.796586:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970429.796588:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970429.796757:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970429.796772:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102303360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970429.796837:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970429.796875:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303360 00000100:00100000:3.0:1788970429.796882:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303360 00000100:00100000:3.0:1788970429.796918:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970429.796926:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8484f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875871102303360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788970429.796950:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970429 with bad export cookie 14099643152403456900 00010000:00010000:2.0:1788970429.801070:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801090:0:15361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801169:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801178:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801258:0:15361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970429.801266:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801274:0:15361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801281:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.801294:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.803010:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970429.803024:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.803035:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970429.803040:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.803049:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970429.803056:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970429.803063:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970429.803066:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788970429.805425:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805442:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970429.805477:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805485:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6e8d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e8d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805528:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970429.805534:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805540:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970429.805544:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805553:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970429.805560:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970429.805566:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970429.805569:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788970429.805598:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805604:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970429.805611:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.805617:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970429.805619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970429.805623:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970429.805694:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102303488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970429.805762:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.805820:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970429.805826:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102303616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970429.805846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970429.805876:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303488 00000100:00100000:1.0:1788970429.805884:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303488 00000100:00100000:1.0:1788970429.805920:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303616 00000100:00100000:1.0:1788970429.805923:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303616 00000100:00100000:1.0:1788970429.805936:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970429.805942:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875871102303488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788970429.805949:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970429 with bad export cookie 14099643152403456900 00000100:00100000:1.0:1788970429.805991:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875871102303488:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (228us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788970429.806007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970429.806024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970429.806029:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875871102303616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788970429.806042:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970429 with bad export cookie 14099643152403456900 00000100:00100000:1.0:1788970429.806069:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875871102303616:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (222us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788970429.806076:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788970429.806192:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788970429.806197:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788970429.806201:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788970429.808445:0:15361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788970429.808461:0:15361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c6e79e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e7a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970429.808507:0:15361:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788970429.808523:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808532:0:15361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808539:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808546:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808560:0:15361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970429.808565:0:15361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808572:0:15361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808578:0:15361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808585:0:15361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.808591:0:15361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788970429.808594:0:15361:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788970429.808597:0:15361:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788970429.808635:0:15361:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788970429.808638:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788970429.808643:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970429.808649:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788970429.808657:0:15361:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a7d831e1800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970429.808663:0:15361:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a7eaec84800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970429.808668:0:15361:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8a7eae153380) has exports, disconnecting them 00000020:00080000:2.0:1788970429.808673:0:15361:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a7d831e1800), last request at 1788970429 00000020:00000080:2.0:1788970429.808679:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e766 00000100:00080000:2.0:1788970429.808697:0:15361:0:(import.c:65:import_set_state_nolock()) ffff8a7d831e2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788970429.808740:0:15361:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d831e1800): rc 0 00000020:00000080:2.0:1788970429.808743:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7d831e1800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788970429.808751:0:15361:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a7eaec84800), last request at 1788970429 00000020:00000080:2.0:1788970429.808754:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e640 00000100:00080000:2.0:1788970429.808758:0:15361:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec83800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788970429.808763:0:15361:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eaec84800): rc 0 00000020:00000080:2.0:1788970429.808764:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eaec84800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788970429.808771:0:15361:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa287c1743ae0 00000100:00080000:2.0:1788970429.808790:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970429.808798:0:15361:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a7d84519a40 x1875871102300160/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788970437 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970429.808809:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1788970429.810237:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970429.810249:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.810287:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970429.810291:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.810301:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970429.810307:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970429.810313:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788970429.810316:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788970429.810319:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1788970429.810804:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8484f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875871102303360:12345-0@lo:103:ldlm_bl.0 Request processed in 13875us (13965us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970429.810815:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788970429.810936:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788970429.814059:0:15361:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788970429.814071:0:15361:0:(import.c:65:import_set_state_nolock()) ffff8a7eb55d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:2.0:1788970429.814629:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831e1800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788970429.814688:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec84800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788970429.814711:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d831e2000 for lustre-MDT0001 00000020:00000080:2.0:1788970429.814716:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaec83800 for lustre-MDT0001 00010000:00010000:2.0:1788970429.814747:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1788970429.817461:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788970429.817470:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788970429.817488:0:15361:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788970429.817574:0:15361:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788970429.817602:0:15361:0:(import.c:65:import_set_state_nolock()) ffff8a7d81acb800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788970429.817617:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788970429.817619:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788970429.817625:0:15361:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788970429.817698:0:15361:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788970429.817705:0:15361:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf421000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788970429.817726:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a7eae153380) has no exports 00000100:00100000:2.0:1788970429.817770:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102303744:0@lo:9:umount.0 00000100:00100000:2.0:1788970429.817829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970429.817857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf5143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102303872:0@lo:9:umount.0 00000100:00100000:2.0:1788970429.817872:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970429.818048:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303744 00000100:00100000:2.0:1788970429.818056:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303744 00000100:00100000:2.0:1788970429.818091:0:8689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102303872 00000100:00100000:2.0:1788970429.818161:0:8689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102303872 00000100:00100000:2.0:1788970429.818184:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788970429.818192:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875871102303744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788970429.818214:0:8689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e68d 00000100:00080000:2.0:1788970429.818222:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d81ac9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970429.818252:0:8689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788970429.818522:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1875871102303744:12345-0@lo:9:umount.0 Request processed in 329us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970429.818529:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788970429.818557:0:8689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788970429.818563:0:8689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875871102303872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788970429.818574:0:8689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e7d6 00000100:00080000:2.0:1788970429.818579:0:8689:0:(import.c:65:import_set_state_nolock()) ffff8a7d81a3e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970429.818596:0:8689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788970429.818658:0:8689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1875871102303872:12345-0@lo:9:umount.0 Request processed in 95us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970429.818664:0:8689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788970429.818697:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d81acb800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788970429.818706:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788970429.818708:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970429.818712:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102303744:0@lo:9:umount.0 00000100:00080000:2.0:1788970429.818720:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf421000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788970429.818725:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788970429.818727:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970429.818729:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf5143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102303872:0@lo:9:umount.0 00010000:00010000:2.0:1788970429.818800:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970429.818807:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.818817:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970429.818822:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.818831:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970429.818839:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970429.818854:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970429.818857:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788970429.818860:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1788970429.823771:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.115@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788970429.823777:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788970429.823787:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d83fec3c0 x1875871102302080/t0(0) o400->MGC192.168.203.115@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788970445 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970429.823802:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d83e84000 x1875871102303360/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970445 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970429.823813:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d8356a940 x1875871102303488/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970445 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970429.823821:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d83568000 x1875871102303616/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970445 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788970429.823829:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788970429.823832:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788970429.823833:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788970429.823958:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a7e84bc0000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788970429.823972:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102300160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970429.824011:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5fe147a8-4210-48cf-8358-c541b06e4cd0:3651:1875871102303360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970429.824166:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.824176:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970429.824199:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970429.824208:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4800/0xc3abfebe76c6eb3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6eb41 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970429.824224:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970429.824233:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:0:1875871102304000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970429.824243:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970429.824246:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970429.824248:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970429.824811:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.824820:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970429.824839:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.824846:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f5400/0xc3abfebe76c6e487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6e48e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970429.824861:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970429.824862:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970429.824864:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970429.824881:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970429.824883:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970429.824976:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf5143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5fe147a8-4210-48cf-8358-c541b06e4cd0:0:1875871102304128:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788970429.825039:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970429.825045:0:3649:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 201 00000100:00080000:1.0:1788970429.825057:0:3649:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e84bc0000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970429.825085:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b3840 x1875871102304256/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970429.825181:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102303488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970429.825192:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102302080:0@lo:400:kworker.0 00000100:00100000:1.0:1788970429.825217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5fe147a8-4210-48cf-8358-c541b06e4cd0:3649:1875871102303616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970429.825268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102304256:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788970429.825406:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102304256 offset 0 length 520: 4 00000020:00080000:3.0:1788970429.836681:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a7eae153380) has no exports 00000020:01000000:2.0:1788970429.949534:0:15361:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d822276c0 - data ffff8a7eb12e2438/ffff8a7eaed71000 00000020:01000000:2.0:1788970429.949692:0:15361:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7ea762d120 - data ffff8a7eb11305e8/ffff8a7eb5746000 00000001:00000004:2.0:1788970429.966745:0:15361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788970430.006704:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970430.006728:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788970430.006738:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788970430.008757:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788970430.008764:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788970430.008783:0:15361:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970430.008785:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788970430.009095:0:8676:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788970430.009100:0:8676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788970430.009110:0:8676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788970430.009710:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788970430.009714:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788970430.009736:0:15361:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970430.009738:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788970430.010207:0:9964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788970430.010212:0:9964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788970430.010221:0:9964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788970430.011223:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4aa 00000020:00000080:0.0:1788970430.011233:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eae15f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788970430.011761:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae15f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788970430.013971:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4bf 00000020:00000080:1.0:1788970430.013985:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eae15d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788970430.014065:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788970430.014071:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970430.014080:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788970430.014084:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8a7eae1519c0) has no exports 00000004:01000000:1.0:1788970430.014246:0:15361:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788970430.014256:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e7c8 00000020:00000080:1.0:1788970430.014260:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7ebf420800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970430.014592:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae15d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788970430.015018:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788970430.015024:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970430.015034:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970430.015038:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8a7d81ae8000) has no exports 00000020:00000080:1.0:1788970430.015045:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e7c1 00000020:00000080:1.0:1788970430.015050:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7ebf420000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788970430.015546:0:15361:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788970430.015551:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788970430.015555:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788970430.015561:0:15361:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970430.015563:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970430.015594:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970430.015602:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970430.015608:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e686 00000020:00000080:1.0:1788970430.015623:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7d824fa800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788970430.015628:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788970430.015630:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970430.015635:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970430.015637:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8a7e8fc83380) has no exports 00000020:00000080:1.0:1788970430.015641:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e67f 00000020:00000080:1.0:1788970430.015644:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7d81ace800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788970430.016023:0:15361:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788970430.016027:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788970430.016029:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788970430.016033:0:15361:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970430.016034:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970430.016059:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970430.016064:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788970430.016076:0:15361:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788970430.016081:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4e2 00000020:00000080:1.0:1788970430.016085:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eb55d2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788970430.016089:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788970430.016093:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970430.016096:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970430.016098:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8a7eb3dc3380) has no exports 00000020:00000080:1.0:1788970430.016102:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4db 00000020:00000080:1.0:1788970430.016105:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eb55d3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788970430.016769:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf420800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788970430.016781:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf420000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788970430.016786:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf421000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788970430.016793:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7ebf422800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970430.016795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf422800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788970430.016800:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788970430.016876:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d824fa800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788970430.016880:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81ace800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788970430.016884:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d81acb800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788970430.017021:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7d81acd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970430.017024:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81acd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788970430.017028:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788970430.017059:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb55d2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788970430.017064:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb55d3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788970430.020447:0:15361:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788970430.020455:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970430.020459:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788970430.020469:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788970430.020532:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970430.020545:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788970430.020577:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970430.020580:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788970430.020586:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eb0074800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788970430.020591:0:15361:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0074800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788970430.020598:0:15361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788970430.020767:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4c6 00000020:00000080:0.0:1788970430.020776:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eae15d000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788970430.020781:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788970430.020784:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970430.020788:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788970430.020792:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8a7eae150000) has no exports 00000020:00000080:0.0:1788970430.020816:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970430.020819:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788970430.020833:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e4cd 00000020:00000080:0.0:1788970430.020838:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eae15e800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788970430.020845:0:15361:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7ebb899800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788970430.020848:0:15361:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebb899800 2 00000020:01000004:0.0:1788970430.020851:0:15361:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7ebb899800 from lustre-MDT0001 00000020:00000080:0.0:1788970430.020866:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970430.020869:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788970430.020872:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eae158800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788970430.020874:0:15361:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae158800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788970430.020880:0:15361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788970430.020924:0:15361:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788970430.020928:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788970430.020930:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970430.020933:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970430.020940:0:15361:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a7eaec83000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970430.020945:0:15361:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8a7e882899c0) has exports, disconnecting them 00000020:00080000:0.0:1788970430.020949:0:15361:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a7eaec83000), last request at 1788970201 00000020:00000080:0.0:1788970430.020953:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e521 00000020:00080000:0.0:1788970430.020966:0:15361:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eaec83000): rc 0 00000020:00000080:0.0:1788970430.020969:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eaec83000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788970430.021798:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb55d6800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788970430.021809:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7ebbaa6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970430.021818:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebbaa6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788970430.021824:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788970430.021929:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae15d000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788970430.021934:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7eae15c000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788970430.021936:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae15c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788970430.021939:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788970430.022121:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae15e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788970430.022127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec83000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788970430.022163:0:15361:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788970430.022167:0:15361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970430.022171:0:15361:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970430.022176:0:15361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970430.022197:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eae08d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788970430.022334:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970430.022342:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788970430.022345:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eae08c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788970430.022347:0:15361:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eae08c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788970430.022351:0:15361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788970430.022401:0:15361:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebb899800 1 00000020:00000080:3.0:1788970430.022406:0:15361:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e45d 00000020:00000080:3.0:1788970430.022411:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7ebbb1b800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788970430.022419:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788970430.022426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebbb1b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788970430.022434:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970430.022438:0:15361:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970430.022441:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8a7e8828cd40) has no exports 00000020:00000080:3.0:1788970430.109165:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970430.109181:0:15361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788970430.109186:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7ebb89e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788970430.109200:0:15361:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebb89e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788970430.109212:0:15361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788970430.109377:0:15361:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7ebb89a000 00000020:01000000:3.0:1788970430.109484:0:15361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788970430.109489:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970430.109493:0:15361:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970430.109497:0:15361:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8a7e8828b380) has no exports 00000100:00100000:2.0:1788970430.112194:0:10102:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8a7d810c0c00:10102] 3 exiting: rc = 0 00000100:00100000:2.0:1788970430.112455:0:6524:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8a7e83dd2e00:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1788970430.112539:0:13652:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8a7d83c08a00:13652] 4 exiting: rc = 0 00000100:00100000:3.0:1788970430.113232:0:6526:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8a7ea76fd400:6526] 2 exiting: rc = 0 00000100:00100000:0.0:1788970430.115847:0:6525:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8a7ea76fde00:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1788970430.117044:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117058:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117065:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117072:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117078:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117153:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117161:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117169:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117175:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117181:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117187:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117194:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117199:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117217:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117224:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117231:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117240:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117250:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117258:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117264:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117269:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117274:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117279:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117284:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117295:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117300:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117306:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117312:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117319:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117327:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117334:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117342:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117348:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117354:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117359:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117365:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117371:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.117376:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118889:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118912:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118934:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118944:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118954:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118965:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118974:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.118984:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119005:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119015:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119026:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119036:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119047:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119056:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119066:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119078:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119087:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119331:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119340:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119345:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119350:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119355:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119360:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119366:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119371:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.119377:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970430.123656:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a7eb0df2800:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1788970430.123775:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a7eb0df2c00:6528] 1 exiting: rc = 0 00000100:00100000:2.0:1788970430.124268:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124278:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124284:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124290:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124297:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124303:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124309:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124315:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124321:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124327:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124334:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124360:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124367:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124372:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124378:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124399:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124406:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124413:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124422:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124431:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124437:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124442:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124448:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124453:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124459:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124465:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124470:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124475:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124479:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124485:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124490:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124496:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124501:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124506:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124511:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124517:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124522:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124527:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124532:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124538:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124544:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124549:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124554:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124559:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124564:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124569:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124583:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124588:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124592:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124597:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124604:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124609:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124614:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124619:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124625:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124629:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124635:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124640:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124646:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124662:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124669:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124675:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124681:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.124686:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125127:0:7833:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8a7ebb8e3600:7833] 2 exiting: rc = 0 00000100:00100000:2.0:1788970430.125230:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8a7e84f89000:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1788970430.125274:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8a7eb0df3400:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1788970430.125310:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125322:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125332:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125339:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125345:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125352:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125365:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125374:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125465:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125474:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125480:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125485:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125491:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125497:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125503:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125516:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125522:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125528:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125553:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125564:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125576:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125584:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125594:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125600:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125610:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125618:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125627:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125635:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125641:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125648:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125672:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125682:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125688:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125694:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125701:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125714:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125720:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125728:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125734:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125741:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125750:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125756:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125781:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125789:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125795:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125803:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125811:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125818:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125825:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125832:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125847:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125853:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125859:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125866:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125888:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125896:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125902:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125909:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125915:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125921:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125928:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125934:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125940:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970430.125954:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.161820:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a7e88373800:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1788970430.165612:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a7e88372800:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1788970430.167243:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167251:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167257:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167262:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167268:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167274:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167279:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167284:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167289:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167294:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167299:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167304:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167310:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167316:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167321:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167327:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167332:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167338:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167343:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167348:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167353:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167358:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167364:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167368:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167373:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167411:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167417:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167422:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167427:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167432:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167438:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167443:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167448:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167453:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167459:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167464:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167468:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167473:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167478:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167482:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167486:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167491:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167495:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167500:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167505:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167510:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167515:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167519:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167524:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167529:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167534:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167539:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167545:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167550:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167554:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167559:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167563:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167568:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167573:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167579:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167594:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167599:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167604:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167608:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.167987:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a7e88372c00:6533] 0 exiting: rc = 1 00000100:00100000:1.0:1788970430.168180:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a7e88373000:6534] 1 exiting: rc = 0 00000100:00100000:3.0:1788970430.171456:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171468:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171474:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171479:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171484:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171489:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171494:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171500:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171506:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171511:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171517:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171521:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171526:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171532:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171537:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171542:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171548:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171553:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171558:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171563:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171568:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171574:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171579:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171584:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171589:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171594:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171599:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171603:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171608:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171613:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171636:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171641:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171646:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171651:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171656:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171660:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171665:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171670:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171675:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171680:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171685:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171690:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171695:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171700:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171704:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171709:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171714:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171718:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171723:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171727:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171732:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171737:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171741:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171745:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171749:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171754:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171758:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171763:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171767:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171772:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171777:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171782:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171788:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.171794:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970430.172593:0:6536:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a7e87864200:6536] 1 exiting: rc = 0 00000100:00100000:3.0:1788970430.173464:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a7e883c5000:6535] 0 exiting: rc = 1 00000100:00100000:3.0:1788970430.173662:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173670:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173677:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173683:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173690:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173696:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173702:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173708:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173713:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173719:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173724:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173729:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173734:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173739:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173744:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173749:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173755:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173760:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173765:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173771:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173776:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173780:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173785:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173790:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173794:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173799:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173804:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173808:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173813:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173817:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173822:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173826:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173830:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173836:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173842:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173856:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173861:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173867:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173873:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173878:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173883:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173888:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173893:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173898:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173903:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173908:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173913:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173918:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173923:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173928:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173933:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173937:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173942:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173947:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173951:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173956:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173961:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173965:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173970:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173975:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173980:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173984:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.173989:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.174008:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.174660:0:6538:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8a7e883ff200:6538] 1 exiting: rc = 0 00000100:00100000:1.0:1788970430.175439:0:6537:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8a7e883fe600:6537] 0 exiting: rc = 1 00000100:00100000:1.0:1788970430.175635:0:6539:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8a7e883c0400:6539] 2 exiting: rc = 0 00000100:00100000:3.0:1788970430.175982:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.175990:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176006:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176012:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176018:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176038:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176044:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176050:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176057:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176063:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176070:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176075:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176081:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176087:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176093:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176098:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176118:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176124:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176129:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176135:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176140:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176146:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176151:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176157:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176162:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176168:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176173:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176179:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176185:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176191:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176196:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176203:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176209:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176215:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176222:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176228:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176234:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176239:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176245:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176250:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176274:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176281:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176287:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176293:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176298:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176304:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176310:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176317:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176322:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176328:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176335:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176340:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176346:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176352:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176358:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176363:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176370:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176376:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176489:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176498:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176503:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176509:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176515:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970430.176522:0:15361:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788970430.183098:0:15361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970430.183115:0:15361:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788970430.183122:0:15361:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c81800/MDS_uuid 00000020:00000080:3.0:1788970430.183126:0:15361:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c81800/MDS_uuid for MDS 00000020:01000000:3.0:1788970430.183139:0:15361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788970430.184445:0:15361:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788970430.498427:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970431.516492:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970432.542479:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970433.573611:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970434.332795:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970434.332821:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970434.332824:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970434.332829:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788970434.332835:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970434.332845:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 448 00000100:00080000:2.0:1788970434.332852:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970434.332868:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7d82192800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970434.332925:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf514780 x1875871102304384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970434.333544:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970434.333550:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788970434.333554:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970434.333569:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 448 00000100:00080000:2.0:1788970434.333573:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970434.333582:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7d82791800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970434.333603:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf514b40 x1875871102304640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970434.333662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102304768:0@lo:400:kworker.0 00000400:00000100:2.0:1788970434.333743:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102304768 offset 0 length 224: 4 00000100:00100000:1.0:1788970434.333905:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102304512:0@lo:400:kworker.0 00000400:00000100:1.0:1788970434.333937:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102304512 offset 0 length 224: 4 00000100:00100000:0.0:1788970434.337151:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102304384:0@lo:38:kworker.0 00000400:00000100:0.0:1788970434.337234:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102304384 offset 0 length 520: 4 00000100:00100000:0.0:1788970434.337283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102304640:0@lo:38:kworker.0 00000400:00000100:0.0:1788970434.337304:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102304640 offset 0 length 520: 4 00010000:00010000:2.0:1788970434.589518:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970435.318311:0:15563:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788970435.344529:0:15563:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788970435.344600:0:15563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970435.344639:0:15563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970435.344648:0:15563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970435.344656:0:15563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970435.344678:0:15563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788970435.344685:0:15563:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788970435.344717:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970435.344733:0:15563:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf514780 x1875871102304384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970454 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970435.344758:0:15563:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788970435.344766:0:15563:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970435.344783:0:15563:0:(import.c:65:import_set_state_nolock()) ffff8a7d82192800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788970435.344789:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970435.344793:0:15563:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf514780 x1875871102304384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970454 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970435.344801:0:15563:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970435.344812:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:2.0:1788970435.345112:0:15362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970435.345121:0:15362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970435.345130:0:15362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970435.345135:0:15362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970435.345144:0:15362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970435.345153:0:15362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970435.345159:0:15362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970435.345162:0:15362:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788970435.345164:0:15362:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788970435.345182:0:15362:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:2.0:1788970435.345185:0:15362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970435.345205:0:15362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a400/0xc3abfebe76c6e8a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e8af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970435.345217:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970435.345219:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970435.345221:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970435.347852:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102304384:0@lo:38:kworker.0 00000100:00080000:3.0:1788970435.350686:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970435.350709:0:15563:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf516d00 x1875871102304512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970435.350732:0:15563:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788970435.350740:0:15563:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788970435.353248:0:15563:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec9d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788970435.353537:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102304512:0@lo:400:kworker.0 00000100:00100000:1.0:1788970435.355972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102304896:0@lo:39:umount.0 00000400:00000100:1.0:1788970435.356052:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102304896 offset 0 length 224: 4 00000100:00080000:1.0:1788970435.356539:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970435.356545:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970435.356549:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970435.356552:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970435.356632:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102305024:0@lo:400:kworker.0 00000400:00000100:2.0:1788970435.356662:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102305024 offset 0 length 224: 4 00010000:00010000:3.0:1788970435.617883:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788970435.876978:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970435.876988:0:9519:0:(genops.c:885:class_export_put()) final put ffff8a7d81a38800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970435.877090:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a38800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788970435.877918:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d81a3e000 for lustre-OST0001 00000001:00100000:3.0:1788970435.879993:0:8435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970435.880002:0:8435:0:(genops.c:885:class_export_put()) final put ffff8a7d81aca800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970435.880968:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81aca800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788970435.881121:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d81ac9000 for lustre-OST0000 00010000:00010000:2.0:1788970436.636533:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970437.660542:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970438.684582:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970439.388573:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970439.388584:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970439.388588:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970439.388591:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970439.388738:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970439.388759:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102305152:0@lo:400:kworker.0 00000400:00000100:2.0:1788970439.388813:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102305152 offset 0 length 224: 4 00000100:00100000:2.0:1788970439.452573:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970429/real 1788970429] req@ffff8a7d836b3840 x1875871102304256/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970439.452605:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d836b3840 x1875871102304256/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970439 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788970439.452625:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970439.452651:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788970439.452655:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102304256:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788970439.452744:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970439.452749:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788970439.452753:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970439.452758:0:13708:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1788970439.452763:0:13708:0:(import.c:630:import_select_connection()) MGC192.168.203.115@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970439.452774:0:13708:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e84bc0000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970439.452807:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e84b40 x1875871102305280/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970439.452838:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970439.452843:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970439.452965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102305280:0@lo:250:kworker.0 00000400:00000100:2.0:1788970439.453008:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102305280 offset 0 length 520: 4 00010000:00010000:2.0:1788970439.708565:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970440.732541:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970441.757250:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970442.785915:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970443.804534:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970444.573093:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970444.573103:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970444.573106:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970444.573110:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970444.573222:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970444.573238:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102305408:0@lo:400:kworker.0 00000400:00000100:2.0:1788970444.573289:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102305408 offset 0 length 224: 4 00010000:00010000:3.0:1788970444.829613:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970445.596638:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970435/real 1788970435] req@ffff8a7d83e87480 x1875871102304896/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970445.596670:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83e87480 x1875871102304896/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970445.596684:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec9d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788970445.596744:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102304896:0@lo:39:umount.0 00000100:00080000:3.0:1788970445.599218:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970445.599226:0:15563:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970445.599253:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788970445.600420:0:15563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.600441:0:15563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.600449:0:15563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.600456:0:15563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.600493:0:15563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970445.600501:0:15563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.603247:0:15563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.603257:0:15563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.603265:0:15563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970445.603308:0:15563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788970445.603315:0:15563:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788970445.603352:0:15563:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788970445.603356:0:15563:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788970445.603363:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970445.603398:0:15563:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970445.603403:0:15563:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8a7d81aecd40) has no exports 00000020:00080000:3.0:1788970445.603429:0:15563:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8a7d81aecd40) has no exports 00010000:00010000:2.0:1788970445.603633:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970445.603641:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603648:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970445.603651:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603660:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970445.603667:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970445.603672:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970445.603675:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788970445.603677:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788970445.603689:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:2.0:1788970445.603694:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603700:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c6e8b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e8bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603714:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970445.603724:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603730:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970445.603732:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603738:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970445.603745:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970445.603750:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788970445.603752:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788970445.603754:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788970445.603759:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:2.0:1788970445.603774:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603786:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82655e00/0xc3abfebe76c6eb2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6eb33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970445.603795:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970445.603797:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970445.603799:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970445.604638:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788970445.608364:0:15563:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d823bb840 - data ffff8a7e932cb870/ffff8a7eaeea2000 00000020:01000000:2.0:1788970445.608766:0:15563:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7ea762df60 - data ffff8a7eb12825e8/ffff8a7d82488800 00100000:10000000:2.0:1788970445.618924:0:15563:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788970445.635439:0:15563:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e5fa 00000020:00000080:1.0:1788970445.635450:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaec86000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788970445.635467:0:15563:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eaed7c000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788970445.635471:0:15563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eaed7c000 2 00000020:01000004:1.0:1788970445.635473:0:15563:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7eaed7c000 from lustre-OST0000 00000020:00000080:1.0:1788970445.635496:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970445.635517:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788970445.635521:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaec86800/lustre-OST0000_UUID 00000020:00000080:1.0:1788970445.635524:0:15563:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec86800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788970445.635530:0:15563:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788970445.635588:0:15563:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788970445.635592:0:15563:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788970445.635595:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970445.635600:0:15563:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788970445.635607:0:15563:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a7d82196800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970445.635613:0:15563:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8a7eaef6b380) has exports, disconnecting them 00000020:00080000:1.0:1788970445.635618:0:15563:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a7d82196800), last request at 1788970221 00000020:00000080:1.0:1788970445.635622:0:15563:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e624 00000020:00080000:1.0:1788970445.635631:0:15563:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d82196800): rc 0 00000020:00000080:1.0:1788970445.635636:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7d82196800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788970445.637285:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec86000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788970445.637301:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d82196800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788970445.637929:0:15563:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788970445.637934:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970445.637938:0:15563:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970445.637943:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970445.638139:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d82192800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788970445.638299:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970445.638307:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788970445.638312:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaef54000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788970445.638315:0:15563:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaef54000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788970445.638320:0:15563:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788970445.639014:0:15563:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788970445.639019:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970445.639026:0:15563:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970445.639242:0:15563:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a7eaec80000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970445.639249:0:15563:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8a7d81ae99c0) has exports, disconnecting them 00000020:00080000:0.0:1788970445.639254:0:15563:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a7eaec80000), last request at 1788970221 00000020:00000080:0.0:1788970445.639259:0:15563:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e639 00000020:00080000:0.0:1788970445.639275:0:15563:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eaec80000): rc 0 00000020:00000080:0.0:1788970445.639279:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaec80000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788970445.640304:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec80000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788970445.658901:0:15563:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788970445.658912:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970445.658916:0:15563:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970445.658924:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970445.658959:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaec9d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788970445.659171:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970445.659180:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788970445.659185:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaec9e000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788970445.659189:0:15563:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec9e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788970445.659200:0:15563:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788970445.659271:0:15563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eaed7c000 1 00000020:00000080:3.0:1788970445.659277:0:15563:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e5c2 00000020:00000080:3.0:1788970445.659283:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaef54800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788970445.659292:0:15563:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788970445.659300:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaef54800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788970445.659309:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970445.659314:0:15563:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970445.659318:0:15563:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8a7eaef6cd40) has no exports 00000020:00000080:3.0:1788970445.747820:0:15563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970445.747834:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788970445.747840:0:15563:0:(genops.c:885:class_export_put()) final put ffff8a7eaed7a800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788970445.747857:0:15563:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaed7a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788970445.747869:0:15563:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788970445.747993:0:15563:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7eaed79000 00000020:02000400:3.0:1788970445.748228:0:15563:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788970445.854279:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970446.878138:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970447.905449:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970448.924578:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970449.592861:0:15765:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788970449.611141:0:15765:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788970449.611227:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970449.611243:0:15765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970449.611251:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970449.611259:0:15765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970449.611282:0:15765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788970449.611288:0:15765:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788970449.611313:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970449.611325:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf514b40 x1875871102304640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970454 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970449.611342:0:15765:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788970449.611350:0:15765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970449.611356:0:15765:0:(import.c:65:import_set_state_nolock()) ffff8a7d82791800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788970449.611361:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970449.611364:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf514b40 x1875871102304640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970454 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970449.611423:0:15765:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970449.611427:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1788970449.611495:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102304640:0@lo:38:kworker.0 00010000:00010000:2.0:1788970449.612642:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970449.612664:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970449.612673:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970449.612676:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970449.612685:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970449.612693:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970449.612699:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970449.612703:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788970449.612706:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788970449.612719:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:2.0:1788970449.612733:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970449.612740:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6e88c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e893 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970449.612760:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970449.612762:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970449.612764:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970449.614229:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970449.614246:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf517840 x1875871102304768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970449.614275:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d836b12c0 x1875871102305024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970451 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970449.614292:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d83e85a40 x1875871102305152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970455 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970449.614302:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7d83569a40 x1875871102305408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970460 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970449.614309:0:15765:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788970449.614342:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102305152:0@lo:400:kworker.0 00000100:00100000:3.0:1788970449.614350:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102305024:0@lo:400:kworker.0 00000100:00080000:3.0:1788970449.614637:0:15765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788970449.614665:0:15765:0:(import.c:65:import_set_state_nolock()) ffff8a7d831e0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788970449.614748:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102305408:0@lo:400:kworker.0 00000100:00100000:2.0:1788970449.614766:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102304768:0@lo:400:kworker.0 00000100:00100000:1.0:1788970449.615310:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102305536:0@lo:39:umount.0 00000400:00000100:1.0:1788970449.615357:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102305536 offset 0 length 224: 4 00000100:00080000:3.0:1788970449.692678:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970449.692688:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788970449.948610:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970450.977263:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970451.997074:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970453.020648:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970454.045109:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970454.748472:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970439/real 1788970439] req@ffff8a7d83e84b40 x1875871102305280/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970454.748522:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83e84b40 x1875871102305280/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970454 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970454.748541:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970454.748565:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788970454.748569:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102305280:0@lo:250:kworker.0 00000100:00080000:2.0:1788970454.748616:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970454.748622:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788970454.748625:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970454.748630:0:13708:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 458 00000100:00080000:2.0:1788970454.748635:0:13708:0:(import.c:630:import_select_connection()) MGC192.168.203.115@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970454.748645:0:13708:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e84bc0000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970454.748675:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf517840 x1875871102305664/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970454.748733:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102305664:0@lo:250:kworker.0 00000400:00000100:1.0:1788970454.748794:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102305664 offset 0 length 520: 4 00010000:00010000:2.0:1788970455.068962:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970456.098867:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970457.119727:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970458.140994:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970459.164961:0:15362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970459.868566:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970449/real 1788970449] req@ffff8a7d83e85a40 x1875871102305536/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970459.868598:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83e85a40 x1875871102305536/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970459 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970459.868618:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d831e0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788970459.868638:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102305536:0@lo:39:umount.0 00000100:00080000:3.0:1788970459.868728:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970459.868733:0:15765:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970459.868738:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788970459.869813:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869843:0:15765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869850:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869858:0:15765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869936:0:15765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970459.869944:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869950:0:15765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869957:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.869963:0:15765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870293:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970459.870306:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870314:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970459.870318:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870327:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970459.870334:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970459.870340:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970459.870342:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788970459.870352:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:0.0:1788970459.870355:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870362:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654400/0xc3abfebe76c6e89a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e8a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870377:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970459.870647:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870655:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970459.870658:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870678:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970459.870684:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970459.870689:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788970459.870691:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788970459.870695:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:0.0:1788970459.870699:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970459.870706:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970459.870708:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970459.870709:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970459.871008:0:15765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970459.871014:0:15765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c6eb1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6eb25 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970459.871029:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788970459.871034:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788970459.871036:0:15765:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788970459.871066:0:15765:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788970459.871069:0:15765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788970459.871074:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970459.871079:0:15765:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970459.871083:0:15765:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8a7eaef68000) has no exports 00000020:00080000:3.0:1788970459.871102:0:15765:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8a7eaef68000) has no exports 00010000:00010000:2.0:1788970459.871496:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788970459.874030:0:15765:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e92c9c7e0 - data ffff8a7d81c6f870/ffff8a7eaed72800 00000020:01000000:3.0:1788970459.874196:0:15765:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d82227a20 - data ffff8a7eb12e5948/ffff8a7d82734000 00100000:10000000:3.0:1788970459.883952:0:15765:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788970459.895789:0:15765:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e720 00000020:00000080:3.0:1788970459.895802:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7eaef55000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788970459.895818:0:15765:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81ace000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788970459.895822:0:15765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81ace000 2 00000020:01000004:3.0:1788970459.895825:0:15765:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7d81ace000 from lustre-OST0001 00000020:00000080:3.0:1788970459.895851:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970459.895859:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788970459.895862:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7d82195800/lustre-OST0001_UUID 00000020:00000080:3.0:1788970459.895865:0:15765:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d82195800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788970459.895871:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788970459.896013:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaef55000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788970459.896121:0:15765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5fe147a8-4210-48cf-8358-c541b06e4cd0->MGS 00010000:00010000:3.0:1788970459.896137:0:15765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7e80031c00/0xc3abfebe76c6e479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970459.896150:0:15765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7e80031c00/0xc3abfebe76c6e479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970459.896156:0:15765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788970459.896159:0:15765:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788970459.896161:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788970459.896178:0:15765:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:3.0:1788970459.896181:0:15765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7e80031c00/0xc3abfebe76c6e479 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e480 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970459.896203:0:15765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970459.896210:0:15765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970459.896215:0:15765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970459.896217:0:15765:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788970459.896219:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788970459.896227:0:15765:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e84bc0000 00010000:00010000:3.0:1788970459.896229:0:15765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6e8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6e903 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788970459.896243:0:15765:0:(import.c:65:import_set_state_nolock()) ffff8a7e84bc0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788970459.896246:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788970459.896248:0:15765:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788970459.896250:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788970459.896254:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788970459.896264:0:15765:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebf517840 x1875871102305664/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788970474 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788970459.896284:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788970459.896286:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788970459.896343:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5fe147a8-4210-48cf-8358-c541b06e4cd0:3648:1875871102305664:0@lo:250:kworker.0 10000000:01000000:3.0:1788970459.899066:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788970459.899083:0:15765:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e376 00000020:00000080:3.0:1788970459.899092:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7ea742e000/5fe147a8-4210-48cf-8358-c541b06e4cd0 00000020:01000000:3.0:1788970459.899118:0:15765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.115@tcp (flags='') 00000020:00000080:3.0:1788970459.899124:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970459.899132:0:15765:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.115@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788970459.899136:0:15765:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8a7e848519c0) has no exports 10000000:01000000:1.0:1788970459.899201:0:6521:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788970459.899270:0:15765:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.115@tcp: client import never connected 00000100:00080000:3.0:1788970459.899284:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788970459.899286:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788970459.899289:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788970459.899291:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788970459.899324:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970459.899330:0:15765:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.115@tcp (uuid 5fe147a8-4210-48cf-8358-c541b06e4cd0) 00000020:01000000:3.0:1788970459.899337:0:15765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788970459.899340:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970459.899344:0:15765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788970459.899358:0:15765:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a7d824f8000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970459.899364:0:15765:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8a7eb3dc0000) has exports, disconnecting them 00000020:00080000:3.0:1788970459.899368:0:15765:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a7d824f8000), last request at 1788970242 00000020:00000080:3.0:1788970459.899372:0:15765:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e74a 00000020:00080000:3.0:1788970459.899401:0:15765:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d824f8000): rc 0 00000020:00000080:3.0:1788970459.899405:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7d824f8000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788970459.899700:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ea742e000/5fe147a8-4210-48cf-8358-c541b06e4cd0 for MGC192.168.203.115@tcp 00000020:00000080:1.0:1788970459.899716:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7e84bc0000 for MGC192.168.203.115@tcp 00000020:00000080:1.0:1788970459.899721:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7e84bc3800/5fe147a8-4210-48cf-8358-c541b06e4cd0 00000020:00000080:1.0:1788970459.899723:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e84bc3800/5fe147a8-4210-48cf-8358-c541b06e4cd0 for MGC192.168.203.115@tcp 00000020:01000000:1.0:1788970459.899727:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.115@tcp (5fe147a8-4210-48cf-8358-c541b06e4cd0) 00000020:00000080:1.0:1788970459.900008:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d824f8000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788970459.901459:0:15765:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788970459.901466:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970459.901469:0:15765:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970459.901475:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788970459.901691:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970459.901700:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788970459.901707:0:15765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788970459.901711:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970459.901715:0:15765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970459.901722:0:15765:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a7d831e7000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970459.901729:0:15765:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8a7d83390000) has exports, disconnecting them 00000020:00080000:0.0:1788970459.901733:0:15765:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a7d831e7000), last request at 1788970242 00000020:00000080:0.0:1788970459.901747:0:15765:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e75f 00000020:00080000:0.0:1788970459.901761:0:15765:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d831e7000): rc 0 00000020:00000080:0.0:1788970459.901766:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7d831e7000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788970459.902095:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d82791800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788970459.902103:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7d82797800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788970459.902106:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d82797800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788970459.902111:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788970459.902170:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831e7000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788970459.907443:0:15765:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788970459.907452:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970459.907457:0:15765:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970459.907464:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970459.907500:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d831e0800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788970459.933803:0:15362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788970459.934019:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788970459.938701:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788970459.938859:0:6507:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a7eb0ed4000:6507] 0 exiting: rc = 1 00000100:00100000:0.0:1788970459.939210:0:6508:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a7eb3dd8e00:6508] 1 exiting: rc = 0 00000100:00100000:0.0:1788970459.939293:0:10401:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8a7d82401800:10401] 2 exiting: rc = 0 00000100:00100000:3.0:1788970459.939473:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.939893:0:6509:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a7ea1eca400:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1788970459.939966:0:6511:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a7e92e8b800:6511] 2 exiting: rc = 0 00000100:00100000:0.0:1788970459.940075:0:7932:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a7eb573e800:7932] 3 exiting: rc = 0 00000100:00100000:0.0:1788970459.955533:0:6510:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a7eb3dd9800:6510] 1 exiting: rc = 0 00000100:00100000:3.0:1788970459.955747:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955757:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955764:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955769:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955774:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955789:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955795:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955800:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955807:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955812:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955818:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955824:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955830:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955836:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955842:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955848:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955953:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955962:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955969:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955975:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955980:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955985:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955991:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.955996:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956001:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956007:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956012:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956018:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956023:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956028:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956032:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956037:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956043:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956047:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956052:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956071:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956076:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956081:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956086:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956091:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956096:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956100:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956105:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956111:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956116:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956121:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956127:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956132:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956138:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956218:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956227:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956232:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956237:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956242:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956247:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956252:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956257:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956262:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956267:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956272:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956277:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956283:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956288:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970459.956300:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788970459.958070:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970459.958082:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788970459.958088:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7d831e5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788970459.958093:0:15765:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831e5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788970459.958098:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788970459.958233:0:15765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81ace000 1 00000020:00000080:3.0:1788970459.958240:0:15765:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6e6ef 00000020:00000080:3.0:1788970459.958246:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7d81a70800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788970459.958266:0:15765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788970459.958271:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970459.958275:0:15765:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788970459.958279:0:15765:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8a7e8fc80000) has no exports 00000020:00000080:0.0:1788970459.958334:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a70800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788970459.993976:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970459.993994:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788970459.993999:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7d81a3a800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788970459.994004:0:15765:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a3a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788970459.994009:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788970459.994892:0:15765:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7d81aca000 00000020:01000000:2.0:1788970459.994920:0:15765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788970459.994926:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970459.994930:0:15765:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788970459.994935:0:15765:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8a7eaef699c0) has no exports 00000020:00000080:2.0:1788970459.994966:0:15765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970459.994973:0:15765:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788970459.994976:0:15765:0:(genops.c:885:class_export_put()) final put ffff8a7eaef50800/OSS_uuid 00000020:00000080:2.0:1788970459.994979:0:15765:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaef50800/OSS_uuid for OSS 00000020:01000000:2.0:1788970459.994983:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788970459.995115:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8a7eaece3a00:8442] 2 exiting: rc = 0 00000100:00100000:2.0:1788970459.995281:0:10104:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8a7d8254e400:10104] 4 exiting: rc = 0 00000100:00100000:1.0:1788970459.995339:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8a7eaece2200:8441] 1 exiting: rc = 0 00000100:00100000:1.0:1788970459.995415:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8a7e87c02600:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1788970459.995843:0:8689:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8a7d8245b200:8689] 3 exiting: rc = 0 00000100:00100000:2.0:1788970459.995957:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.995976:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.995983:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.995989:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.995995:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996001:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996006:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996011:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996017:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996022:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996027:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996032:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996036:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996041:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996046:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996051:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996056:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996061:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996066:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996070:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996075:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996080:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996084:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996090:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996095:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996100:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996105:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996110:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996115:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996120:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996125:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996130:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996135:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996151:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996158:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996163:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996175:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996180:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996185:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996191:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996196:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996201:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996206:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996211:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996216:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996222:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996226:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996232:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996236:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996242:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996246:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996252:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996257:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996262:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996267:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996273:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996279:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996284:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996289:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996294:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996299:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996304:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996310:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.996320:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1788970459.998477:0:6519:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788970459.998882:0:13816:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8a7d82178800:13816] 2 exiting: rc = 0 00000100:00100000:0.0:1788970459.998896:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a7eaece2600:8444] 1 exiting: rc = 0 00000100:00100000:3.0:1788970459.999006:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a7ebba68000:8443] 0 exiting: rc = 1 00000100:00100000:2.0:1788970459.999085:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999093:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999100:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999105:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999111:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999116:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999122:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999141:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999158:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999164:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999168:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999173:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999178:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999183:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999188:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999194:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999200:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999205:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999209:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999214:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999219:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999224:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999229:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999234:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999239:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999244:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999250:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999255:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999259:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999264:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999269:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999274:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999279:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999284:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999289:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999294:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999299:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999304:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999309:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999314:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999320:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999325:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999341:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999346:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999351:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999357:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999362:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999367:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999372:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999378:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999421:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999427:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999433:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999438:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999444:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999450:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999456:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999461:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999466:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999471:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999476:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999481:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999486:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970459.999500:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.003080:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a7eaece2a00:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1788970460.004614:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a7eaecf3200:8445] 0 exiting: rc = 1 00000100:00100000:3.0:1788970460.008213:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a7eaece2400:8447] 2 exiting: rc = 0 00000100:00100000:1.0:1788970460.010141:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010150:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010157:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010162:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010168:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010183:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010191:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010196:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010212:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010218:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010224:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010229:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010234:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010240:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010260:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010266:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010271:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010413:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010422:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010428:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010434:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010439:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010445:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010451:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010456:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010461:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010466:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010472:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010477:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010483:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010489:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010495:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010501:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010506:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010511:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010517:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010523:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010529:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010548:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010555:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010560:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010566:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010571:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010582:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010588:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010593:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010599:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010605:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010611:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010617:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010622:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010628:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010634:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010639:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010645:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010650:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010656:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010669:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010682:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010688:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010693:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010698:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010703:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970460.010715:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970460.025032:0:8448:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a7ebb8f7e00:8448] 0 exiting: rc = 1 00000100:00100000:0.0:1788970460.025322:0:8449:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a7e883f8600:8449] 1 exiting: rc = 0 00000100:00100000:0.0:1788970460.025424:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025451:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025457:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025462:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025467:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025473:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025479:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025484:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025490:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025496:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025501:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025506:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025513:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025519:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025525:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025531:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025536:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025554:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025559:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025564:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025570:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025575:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025582:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025587:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025592:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025597:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025602:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025608:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025613:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025619:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025625:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025630:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025635:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025641:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025646:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025651:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025657:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025662:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025667:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025672:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025875:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025880:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025885:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025890:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025896:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025900:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025905:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025910:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025914:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025926:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025932:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025937:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025950:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025955:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025961:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025965:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025970:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025975:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025981:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025986:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025991:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.025996:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.026002:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.026011:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970460.027851:0:8451:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a7ebba6b600:8451] 1 exiting: rc = 0 00000100:00100000:3.0:1788970460.027875:0:8450:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a7e883f8c00:8450] 0 exiting: rc = 1 00000100:00100000:2.0:1788970460.028155:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028166:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028172:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028179:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028186:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028209:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028216:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028222:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028228:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028233:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028238:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028244:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028261:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028266:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028272:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028547:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.028555:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029357:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029366:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029372:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029378:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029566:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029572:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029578:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029583:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029589:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029594:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029601:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029606:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029627:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029634:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029639:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029644:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029650:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029655:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029662:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029668:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029738:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029746:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029752:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029757:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029789:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029797:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029805:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029811:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029817:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029822:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029839:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029845:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029850:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029856:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029861:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029867:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029887:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029894:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029901:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029907:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029914:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029919:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029925:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029932:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029938:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029944:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970460.029960:0:15765:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788970460.040660:0:15765:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788970477.713059:0:16529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788970487.401766:0:17129:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788970487.401771:0:17129:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788970487.401773:0:17129:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788970487.401881:0:17129:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7e92fc7000 00000020:01000004:1.0:1788970487.401897:0:17129:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788970487.401904:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788970487.401920:0:17129:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a7eb3dc19c0) 00000020:00000080:1.0:1788970487.401934:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788970487.485059:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788970487.486701:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.488428:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788970487.489161:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788970487.489425:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.489775:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788970487.490018:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.490273:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.490682:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.490936:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788970487.491165:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788970487.491465:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788970487.491863:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.492113:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.493905:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788970487.495349:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.495928:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.496169:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.496467:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.496945:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.497359:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.497733:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.498057:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.498292:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.498636:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.498888:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.499128:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.499431:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.499703:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.499937:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.500186:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.500759:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788970487.500955:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788970487.501145:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.505439:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.506119:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.506499:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.506768:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.507017:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.507275:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.507644:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.508046:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.508287:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.508615:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.508810:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788970487.508998:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.509198:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788970487.510272:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788970487.511110:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788970487.511564:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788970487.512256:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788970487.512589:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788970487.512841:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788970487.513313:0:17129:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788970487.513951:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788970487.513959:0:17129:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788970487.513973:0:17129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f925 00000020:01000004:2.0:1788970487.513980:0:17129:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788970487.513984:0:17129:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788970487.513989:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7e92fc7000 from MGS 00000020:01000004:2.0:1788970487.513993:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788970487.514003:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a7d81ae99c0) 00000020:00000080:2.0:1788970487.514013:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788970487.514069:0:17129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7e92fc7000 from MGS, refs=2 00080000:01000000:2.0:1788970487.514074:0:17129:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788970487.514078:0:17129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f933 00000100:00100000:2.0:1788970487.514179:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788970487.514350:0:17129:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788970487.514357:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788970487.519167:0:17129:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788970487.519179:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788970487.519912:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970487.520097:0:17129:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788970487.520102:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788970487.520613:0:17129:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788970487.520620:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788970487.520900:0:17129:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788970487.520906:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788970487.521422:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970487.521426:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970487.521427:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970487.521829:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970487.521832:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970487.521834:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970487.526641:0:17129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788970487.534662:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788970487.539735:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788970487.545757:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788970487.545994:0:17129:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788970487.546046:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788970487.547575:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788970487.547882:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970487.548055:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788970487.548061:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788970487.550817:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788970487.550829:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788970487.551761:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788970487.551769:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788970487.556734:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788970487.556757:0:17129:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.115@tcp' 00000020:01000004:3.0:1788970487.556759:0:17129:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788970487.556788:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.115@tcp (typ=mgc) 00000020:00000080:3.0:1788970487.556800:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.115@tcp (ffff8a7d83390000) 00000020:00000080:3.0:1788970487.556815:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788970487.556936:0:17129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7e86331800@MGC192.168.203.115@tcp: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970487.557078:0:17129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.115@tcp-0 is initialized 00000040:01000000:3.0:1788970487.557093:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788970487.557355:0:17146:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788970487.566641:0:17147:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788970487.566759:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.115@tcp (uuid 3c12dceb-6b52-416d-b090-7691eb149d35) 00000020:00000080:1.0:1788970487.566793:0:17129:0:(genops.c:1384:class_connect()) connect: client 3c12dceb-6b52-416d-b090-7691eb149d35, cookie 0xc3abfebe76c6f941 00000100:00080000:1.0:1788970487.566807:0:17129:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970487.566818:0:17129:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e86331800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970487.566851:0:17129:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b30c0 x1875871102305792/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970487.566877:0:17129:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3c12dceb-6b52-416d-b090-7691eb149d35->MGS 00000020:01000004:1.0:1788970487.566904:0:17129:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788970487.566910:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788970487.566922:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a7eb3dc4d40) 00000020:00000080:1.0:1788970487.566932:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788970487.567605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102305792:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788970487.567675:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970487.567747:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102305792 00000100:00100000:2.0:1788970487.567754:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102305792 00000100:00100000:2.0:1788970487.567785:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970487.567792:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3648:x1875871102305792:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788970487.567815:0:17144:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3c12dceb-6b52-416d-b090-7691eb149d35@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1788970487.567839:0:17144:0:(genops.c:1384:class_connect()) connect: client 3c12dceb-6b52-416d-b090-7691eb149d35, cookie 0xc3abfebe76c6f94f 00000100:00080000:2.0:1788970487.567952:0:17144:0:(import.c:65:import_set_state_nolock()) ffff8a7d83fcb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970487.568001:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+5:3648:x1875871102305792:12345-0@lo:250:mount.lustre.0 Request processed in 208us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.568008:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970487.568050:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788970487.568058:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.115@tcp: connect to target with instance 0 00000100:00080000:2.0:1788970487.568067:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788970487.568071:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788970487.568075:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788970487.568077:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788970487.568086:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788970487.568098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102305792:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788970487.593975:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970487.594164:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788970487.594171:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788970487.596822:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788970487.596841:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788970487.597298:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788970487.597306:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788970487.598798:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970487.599040:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788970487.599045:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788970487.606716:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788970487.606819:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788970487.678056:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970487.678266:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788970487.678273:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788970487.679325:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788970487.679335:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788970487.680956:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970487.681134:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788970487.681139:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788970487.684721:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788970487.684734:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788970487.685813:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970487.685990:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788970487.685996:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788970487.689622:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788970487.689639:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788970487.690240:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970487.690435:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788970487.690440:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788970487.703119:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970487.703260:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788970487.755804:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970487.756067:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970487.756073:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788970487.759595:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970487.759612:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788970487.760797:0:17129:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788970487.760808:0:17129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788970487.761807:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788970487.761839:0:17129:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788970487.761846:0:17129:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970487.761962:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970487.761999:0:17129:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788970487.762004:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970487.762006:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970487.762007:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970487.762009:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970487.762010:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970487.762011:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970487.762012:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970487.762014:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970487.762015:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970487.762017:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970487.762019:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788970487.762021:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970487.762022:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970487.762023:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970487.762025:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970487.762026:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970487.762027:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970487.762028:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970487.762029:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970487.762029:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970487.762030:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970487.762060:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788970487.762088:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102305920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970487.762173:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970487.762320:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.764790:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102305920 00000100:00100000:2.0:1788970487.764806:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102305920 00000100:00100000:2.0:1788970487.764875:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970487.764885:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+5:17129:x1875871102305920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970487.764954:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788970487.764958:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788970487.764961:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788970487.765527:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788970487.766104:0:17145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788970487.772355:0:17167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788970487.772363:0:17167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788970487.772367:0:17167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788970487.772369:0:17167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788970487.774452:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788970487.775110:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788970487.775122:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788970487.779173:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+5:17129:x1875871102305920:12345-0@lo:253:mount.lustre.0 Request processed in 14281us (16991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.779189:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970487.779346:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102305920:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788970487.779361:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788970487.779364:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970487.779366:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970487.779367:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970487.779368:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970487.779369:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970487.779371:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970487.779372:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970487.779373:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970487.779374:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970487.779376:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970487.779667:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7e92fc7000 from lustre-MDT0000 10000000:01000000:0.0:1788970487.779696:0:17129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788970487.779699:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788970487.779714:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a7d83390000 10000000:01000000:0.0:1788970487.779718:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970487.779726:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7d83390000 from 1 10000000:01000000:0.0:1788970487.779728:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788970487.779763:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.779775:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.779786:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970487.779803:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970487.779838:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970487.779910:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.779980:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306048 00000100:00100000:2.0:1788970487.779986:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306048 00000100:00100000:2.0:1788970487.780055:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970487.780063:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+5:17129:x1875871102306048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970487.780074:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970487.780086:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9c00/0xc3abfebe76c6f95d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6f956 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.780114:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9c00/0xc3abfebe76c6f95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6f956 expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.780124:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9c00/0xc3abfebe76c6f95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6f956 expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.780133:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9c00, rc 0) 00000100:00100000:2.0:1788970487.780210:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+6:17129:x1875871102306048:12345-0@lo:101:mount.lustre.0 Request processed in 147us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.780216:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970487.780342:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970487.780354:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.780363:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970487.780438:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970487.780460:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970487.780519:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.780969:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306176 00000100:00100000:2.0:1788970487.780975:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306176 00000100:00100000:2.0:1788970487.781008:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970487.781014:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+6:17129:x1875871102306176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970487.781092:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+6:17129:x1875871102306176:12345-0@lo:501:mount.lustre.0 Request processed in 78us (631us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970487.781098:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970487.781176:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306176:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788970487.781213:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788970487.781228:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.781237:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970487.781244:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7e92fc7000 10000000:01000000:1.0:1788970487.781249:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788970487.781253:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a7e92fc7000 10000000:01000000:1.0:1788970487.781262:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788970487.781264:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a7e92fc7000 from 1 10000000:01000000:1.0:1788970487.781267:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788970487.781287:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.781294:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.781303:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970487.781316:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970487.781340:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.781352:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.781474:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306304 00000100:00100000:2.0:1788970487.781486:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306304 00000100:00100000:2.0:1788970487.781502:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970487.781507:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+6:17129:x1875871102306304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970487.781513:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970487.781523:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8a00/0xc3abfebe76c6f96b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6f964 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.781538:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8a00/0xc3abfebe76c6f96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6f964 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.781556:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8a00/0xc3abfebe76c6f96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6f964 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.781564:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8a00, rc 0) 00000100:00100000:2.0:1788970487.781599:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+7:17129:x1875871102306304:12345-0@lo:101:mount.lustre.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.781606:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970487.782371:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970487.782411:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.782421:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970487.782435:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788970487.782443:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.782450:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970487.782457:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788970487.782467:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970487.782472:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a7e92fc7000 10000000:01000000:1.0:1788970487.782591:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788970487.782595:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788970487.782598:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788970487.782622:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.782628:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.782636:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970487.782651:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970487.782691:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.782725:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.782778:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306432 00000100:00100000:2.0:1788970487.782784:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306432 00000100:00100000:2.0:1788970487.782813:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970487.782821:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+7:17129:x1875871102306432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970487.782830:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970487.782839:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8200/0xc3abfebe76c6f979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6f972 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.782855:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8200/0xc3abfebe76c6f979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6f972 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.782864:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8200/0xc3abfebe76c6f979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6f972 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.782871:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8200, rc 0) 00000100:00100000:2.0:1788970487.782987:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+8:17129:x1875871102306432:12345-0@lo:101:mount.lustre.0 Request processed in 167us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.782994:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970487.783062:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970487.783073:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.783081:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970487.783134:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970487.783158:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.783178:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970487.783285:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306560 00000100:00100000:0.0:1788970487.783290:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306560 00000100:00100000:0.0:1788970487.783309:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970487.783325:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+8:17129:x1875871102306560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970487.783549:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+9:17129:x1875871102306560:12345-0@lo:501:mount.lustre.0 Request processed in 151us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970487.783558:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970487.783995:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970487.784061:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970487.784106:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.784132:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970487.784751:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306688 00000100:00100000:0.0:1788970487.784759:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306688 00000100:00100000:0.0:1788970487.784971:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970487.784982:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+9:17129:x1875871102306688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970487.792531:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+9:17129:x1875871102306688:12345-0@lo:503:mount.lustre.0 Request processed in 7541us (8414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970487.792545:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970487.792679:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102306688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970487.795451:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17168:1875871102306816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970487.795551:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970487.795614:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306816 00000100:00100000:2.0:1788970487.795622:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306816 00000100:00100000:2.0:1788970487.795660:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970487.795670:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+9:17168:x1875871102306816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970487.795847:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970487.797913:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+9:17168:x1875871102306816:12345-0@lo:502:llog_process_th.0 Request processed in 2235us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.797931:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970487.799166:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17168:1875871102306816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970487.799211:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970487.799223:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.799226:0:17168:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788970487.799230:0:17168:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788970487.799233:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970487.799250:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a7d81aecd40) 00000020:00000080:2.0:1788970487.799267:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788970487.799273:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788970487.799359:0:17168:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788970487.799366:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f987 00000020:00000080:2.0:1788970487.799624:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788970487.799629:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970487.799632:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.799634:0:17168:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788970487.799637:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970487.799640:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.799642:0:17168:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788970487.799645:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970487.799654:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a7d81ae8000) 00000020:00000080:2.0:1788970487.799663:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788970487.799667:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788970487.799669:0:17168:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788970487.799671:0:17168:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788970487.799678:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788970487.799735:0:17168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7e92fc7000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788970487.799752:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a7d81aeb380) 00000020:00000080:2.0:1788970487.799761:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788970487.799816:0:17168:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788970487.799823:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6f99c 00000020:00000080:2.0:1788970487.799916:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788970487.799921:0:17168:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788970487.799927:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3abfebe76c6f9a3 00080000:01000000:2.0:1788970487.799931:0:17168:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788970487.799934:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f9aa 00010000:00010000:1.0:1788970487.872679:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788970487.874066:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1788970487.876819:0:17168:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788970487.878750:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a7eb3dc0000) 00000020:00000080:1.0:1788970487.878772:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788970487.878870:0:17168:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788970487.878881:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f9b8 00000020:00000080:2.0:1788970487.890588:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788970487.896687:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3abfebe76c6f9bf 00000020:00000080:2.0:1788970487.905691:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788970487.905705:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970487.905785:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.905788:0:17168:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788970487.905794:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788970487.905796:0:17168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788970487.905797:0:17168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970487.905799:0:17168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970487.905800:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788970487.905803:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.905804:0:17168:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788970487.905806:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970487.905810:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.905812:0:17168:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788970487.905817:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788970487.905894:0:17168:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788970487.905916:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970487.905919:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.905921:0:17168:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788970487.905923:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970487.905926:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.905928:0:17168:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788970487.905930:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788970487.905935:0:17168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:3.0:1788970487.905973:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970487.905990:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a7d83394d40) 00000020:00000080:3.0:1788970487.906006:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788970487.906011:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788970487.906066:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788970487.906071:0:17168:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788970487.906078:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f9cd 00010000:00080000:3.0:1788970487.906107:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf3b3800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970487.907885:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788970487.916067:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970487.916084:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788970487.916131:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788970487.916153:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6f9d4 00000100:00080000:2.0:1788970487.916163:0:17168:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970487.916174:0:17168:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7ebf3b3800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970487.917082:0:17168:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf516940 x1875871102306944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970487.917117:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788970487.917188:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970487.917202:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.917205:0:17168:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788970487.917208:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788970487.917211:0:17168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788970487.917212:0:17168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970487.917214:0:17168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970487.917215:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788970487.917217:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.917219:0:17168:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788970487.917235:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970487.917240:0:17168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788970487.917243:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.917245:0:17168:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788970487.917247:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788970487.917251:0:17168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1788970487.917273:0:17168:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788970487.917276:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970487.917300:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a7ebd8ecd40) 00000020:00000080:2.0:1788970487.917316:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788970487.917321:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788970487.917408:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788970487.917414:0:17168:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788970487.917420:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f9e2 00010000:00080000:2.0:1788970487.917455:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7eb145c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.115@tcp at head 00000100:00100000:0.0:1788970487.917574:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102306944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788970487.917653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.917804:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102306944 00000100:00100000:1.0:1788970487.917813:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102306944 00010000:00010000:2.0:1788970487.917844:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788970487.917859:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970487.917867:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102306944:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788970487.917884:0:17155:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1788970487.921460:0:17168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788970487.921866:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788970487.927450:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970487.928081:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788970487.942760:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788970487.943423:0:17174:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788970487.943430:0:17174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788970487.944169:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970487.944181:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788970487.944219:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788970487.944240:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6f9e9 00000100:00080000:3.0:1788970487.944250:0:17168:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970487.944260:0:17168:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7eb145c000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970487.944301:0:17168:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e870c0 x1875871102307072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970487.944371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102307072:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788970487.944451:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102307072 offset 0 length 520: 4 00000100:00080000:3.0:1788970487.944650:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788970487.944739:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970487.944744:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.944745:0:17168:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788970487.944748:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788970487.944751:0:17168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788970487.944752:0:17168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970487.944754:0:17168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970487.944755:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788970487.944758:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.944759:0:17168:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788970487.944760:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788970487.944765:0:17168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788970487.944767:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970487.944768:0:17168:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788970487.944771:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788970487.944774:0:17168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:3.0:1788970487.944794:0:17168:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788970487.944796:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970487.944807:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a7d833919c0) 00000020:00000080:3.0:1788970487.944820:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788970487.944824:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788970487.944879:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788970487.944885:0:17168:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788970487.944890:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c6f9f7 00010000:00080000:3.0:1788970487.944931:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf3b5000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970487.945341:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788970487.945427:0:17168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788970487.945441:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788970487.953042:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102306944:12345-0@lo:38:llog_process_th.0 Request processed in 35168us (35382us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970487.953062:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788970487.953156:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970487.953163:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970487.953167:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102306944:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788970487.956137:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970487.956853:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788970487.957049:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788970487.959524:0:17176:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788970487.959533:0:17176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788970487.961346:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970487.961360:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788970487.961425:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788970487.961447:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6f9fe 00000100:00080000:0.0:1788970487.961459:0:17168:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970487.961471:0:17168:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7ebf3b5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970487.961640:0:17168:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83568f00 x1875871102307200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970487.961673:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788970487.961774:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970487.961778:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970487.961780:0:17168:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788970487.961783:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970487.961787:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970487.961788:0:17168:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788970487.961791:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970487.961793:0:17168:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788970487.961795:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970487.961797:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970487.961799:0:17168:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788970487.961801:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970487.961803:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970487.961804:0:17168:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970487.961808:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788970487.961837:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17168:1875871102307328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970487.961910:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970487.961962:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.962112:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102307200:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788970487.962153:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102307200 offset 0 length 520: 4 00000100:00100000:3.0:1788970487.962428:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102307328 00000100:00100000:3.0:1788970487.962435:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102307328 00000100:00100000:3.0:1788970487.962490:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970487.962499:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+9:17168:x1875871102307328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970487.962635:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+9:17168:x1875871102307328:12345-0@lo:502:llog_process_th.0 Request processed in 136us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.962642:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970487.962850:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17168:1875871102307328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788970487.962878:0:17168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970487.962884:0:17168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970487.962886:0:17168:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788970487.962890:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788970487.963156:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788970487.963179:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788970487.963323:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.963335:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970487.963343:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7e92fc7000 from 1 10000000:01000000:3.0:1788970487.963346:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970487.963375:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.963421:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.963430:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970487.963446:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970487.963876:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970487.963915:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8580fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970487.963976:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102307456 00000100:00100000:3.0:1788970487.963983:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102307456 00000100:00100000:3.0:1788970487.964024:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970487.964033:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+9:17129:x1875871102307456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970487.964044:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970487.964059:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa05 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.964093:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.964104:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.964112:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:3.0:1788970487.964157:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+10:17129:x1875871102307456:12345-0@lo:101:mount.lustre.0 Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.964163:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970487.964272:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970487.964295:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.964310:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970487.964896:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307584:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788970487.964934:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970487.964955:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970487.965319:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102307584 00000100:00100000:3.0:1788970487.965325:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102307584 00000100:00100000:3.0:1788970487.965364:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970487.965372:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+10:17129:x1875871102307584:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788970487.965413:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788970487.965419:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788970487.965622:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+10:17129:x1875871102307584:12345-0@lo:256:mount.lustre.0 Request processed in 251us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.965630:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970487.965898:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307584:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788970487.966809:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970487.967642:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.967657:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970487.967665:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7e92fc7000 from 1 10000000:01000000:0.0:1788970487.967668:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970487.967704:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.967713:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970487.967724:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970487.967747:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970487.967803:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970487.967898:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970487.968079:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102307712 00000100:00100000:3.0:1788970487.968093:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102307712 00000100:00100000:3.0:1788970487.968157:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970487.968167:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+10:17129:x1875871102307712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970487.968179:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970487.968191:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa13 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.968214:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.968224:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970487.968231:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655200, rc 0) 00000100:00100000:1.0:1788970487.968512:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970487.968527:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970487.968535:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970487.968629:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970487.968661:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.968683:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970487.968920:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+11:17129:x1875871102307712:12345-0@lo:101:mount.lustre.0 Request processed in 112us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.968930:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970487.968972:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102307840 00000100:00100000:3.0:1788970487.968977:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102307840 00000100:00100000:3.0:1788970487.968995:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970487.969002:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+11:17129:x1875871102307840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970487.969140:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+11:17129:x1875871102307840:12345-0@lo:501:mount.lustre.0 Request processed in 138us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.969147:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970487.969421:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970487.969471:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970487.969633:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.969647:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970487.969727:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102307968 00000100:00100000:0.0:1788970487.969732:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102307968 00000100:00100000:0.0:1788970487.969756:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970487.969762:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+11:17129:x1875871102307968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970487.969850:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+11:17129:x1875871102307968:12345-0@lo:503:mount.lustre.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970487.969858:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970487.969977:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102307968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970487.970846:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17178:1875871102308096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970487.970896:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970487.970969:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970487.971067:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308096 00000100:00100000:0.0:1788970487.971074:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308096 00000100:00100000:0.0:1788970487.971153:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970487.971162:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+11:17178:x1875871102308096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970487.971794:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+11:17178:x1875871102308096:12345-0@lo:502:llog_process_th.0 Request processed in 631us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970487.971802:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970487.971894:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17178:1875871102308096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970487.971924:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970487.971933:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.971936:0:17178:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788970487.971943:0:17178:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7e92fc7000 00000020:00000080:2.0:1788970487.971945:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970487.971992:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970487.971996:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.971997:0:17178:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788970487.971999:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970487.972001:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.972003:0:17178:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788970487.972017:0:17178:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7e92fc7000 00000020:00000080:2.0:1788970487.972019:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970487.972068:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970487.972071:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.972072:0:17178:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788970487.972074:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970487.972077:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.972078:0:17178:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970487.972081:0:17178:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7e92fc7000 00000020:00000080:2.0:1788970487.972083:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970487.972101:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970487.972104:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.972106:0:17178:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970487.972108:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970487.972110:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.972112:0:17178:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788970487.972115:0:17178:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7e92fc7000 00000020:00000080:2.0:1788970487.972117:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970487.972159:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17178:1875871102308224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970487.972204:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970487.977838:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308224 00000100:00100000:3.0:1788970487.977855:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308224 00000100:00100000:3.0:1788970487.977909:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970487.977920:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+11:17178:x1875871102308224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970487.978090:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+11:17178:x1875871102308224:12345-0@lo:502:llog_process_th.0 Request processed in 171us (5885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970487.978098:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788970487.989678:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.990045:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17178:1875871102308224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970487.990089:0:17178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970487.990098:0:17178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970487.990100:0:17178:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788970487.990106:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788970487.990730:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788970487.990759:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970487.990775:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.990799:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970487.990851:0:17129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788970487.990855:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7e92fc7000 10000000:01000000:2.0:1788970487.990858:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7e92fc7000 10000000:01000000:2.0:1788970487.990862:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970487.990868:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7e92fc7000 from 1 10000000:01000000:2.0:1788970487.990871:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970487.990908:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.990917:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.990927:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970487.990959:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102308352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970487.991025:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970487.991060:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.996910:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308352 00000100:00100000:2.0:1788970487.996926:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308352 00000100:00100000:2.0:1788970487.997000:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970487.997010:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+11:17129:x1875871102308352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970487.997026:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970487.997045:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8600/0xc3abfebe76c6fa28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa21 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.997085:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8600/0xc3abfebe76c6fa28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa21 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.997097:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8600/0xc3abfebe76c6fa28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa21 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.997106:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8600, rc 0) 00000100:00100000:2.0:1788970487.997182:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102308352:12345-0@lo:101:mount.lustre.0 Request processed in 173us (6156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.997189:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970487.997250:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102308352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970487.997267:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970487.997276:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970487.997346:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102308480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970487.997374:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970487.997419:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.997435:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308480 00000100:00100000:2.0:1788970487.997439:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308480 00000100:00100000:2.0:1788970487.997460:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970487.997466:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102308480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970487.997608:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102308480:12345-0@lo:501:mount.lustre.0 Request processed in 142us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.997624:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970487.997659:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102308480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970487.997696:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102308608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970487.997729:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970487.997741:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970487.997753:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308608 00000100:00100000:2.0:1788970487.997756:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308608 00000100:00100000:2.0:1788970487.997777:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970487.997783:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102308608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970487.997860:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102308608:12345-0@lo:503:mount.lustre.0 Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970487.997866:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970487.997906:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102308608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970488.006078:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17183:1875871102308736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970488.006162:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970488.006212:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970488.006330:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308736 00000100:00100000:3.0:1788970488.006338:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308736 00000100:00100000:3.0:1788970488.006409:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788970488.006418:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17183:x1875871102308736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970488.006682:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17183:x1875871102308736:12345-0@lo:502:llog_process_th.0 Request processed in 264us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970488.006690:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970488.008727:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17183:1875871102308736:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788970488.008805:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788970488.008820:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a7ebd8e99c0) 00000020:00000080:2.0:1788970488.008842:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788970488.008957:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7e92fc7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788970488.008962:0:17183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7e92fc7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788970488.008964:0:17183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7e92fc7000 4 00010000:00080000:2.0:1788970488.008992:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7eb3da5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1788970488.015098:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788970488.018796:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788970488.018848:0:17183:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788970488.018860:0:17183:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3abfebe76c6fa36 00000100:00080000:1.0:1788970488.018871:0:17183:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970488.018882:0:17183:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a7eb3da5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970488.018916:0:17183:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b03c0 x1875871102308864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970488.018938:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788970488.019156:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102308864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970488.019214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970488.019448:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17183:1875871102308992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970488.019687:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970488.019707:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e844256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970488.019749:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308992 00000100:00100000:2.0:1788970488.019755:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308992 00000100:00100000:2.0:1788970488.019789:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788970488.019796:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:17183:x1875871102308992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970488.019913:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:17183:x1875871102308992:12345-0@lo:502:llog_process_th.0 Request processed in 116us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970488.019920:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970488.021676:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17183:1875871102308992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970488.021747:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17183:1875871102309120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970488.021801:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970488.021843:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e844256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970488.021988:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309120 00000100:00100000:2.0:1788970488.021995:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309120 00000100:00100000:2.0:1788970488.022033:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970488.022041:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:17183:x1875871102309120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970488.022152:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:17183:x1875871102309120:12345-0@lo:502:llog_process_th.0 Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970488.022160:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788970488.022300:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c12dceb-6b52-416d-b090-7691eb149d35:17183:1875871102309120:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788970488.022320:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788970488.022908:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788970488.022931:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970488.022957:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.022969:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970488.023017:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970488.023019:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970488.023021:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970488.023022:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970488.023028:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970488.023029:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970488.023031:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970488.023032:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970488.023034:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970488.023035:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970488.023039:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788970488.023041:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970488.023042:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970488.023043:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970488.023044:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970488.023045:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970488.023046:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970488.023047:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970488.023048:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970488.023049:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970488.023049:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970488.023067:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788970488.023078:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102309248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970488.023113:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970488.023138:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970488.023161:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309248 00000100:00100000:2.0:1788970488.023165:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309248 00000100:00100000:2.0:1788970488.023192:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970488.023199:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102309248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970488.023219:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788970488.023233:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788970488.026871:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102308864 00000100:00100000:3.0:1788970488.026884:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102308864 00000100:00100000:3.0:1788970488.026918:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970488.026925:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102308864:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970488.027025:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102308864:12345-0@lo:38:llog_process_th.0 Request processed in 98us (7809us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788970488.027032:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970488.027791:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970488.027815:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970488.027820:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788970488.027824:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102308864:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788970488.029911:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788970488.029936:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788970488.030297:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17129:x1875871102309248:12345-0@lo:253:mount.lustre.0 Request processed in 7094us (7178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970488.030309:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1788970488.030938:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788970488.030944:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788970488.030986:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.031003:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.031013:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.031050:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.031065:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 11 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970488.031079:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102309376:0@lo:104: 00000100:00100000:2.0:1788970488.031119:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970488.031165:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970488.031210:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17129:1875871102309248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970488.031221:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788970488.031224:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970488.031226:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970488.031227:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970488.031228:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970488.031229:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970488.031230:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970488.031231:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970488.031233:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970488.031234:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970488.031236:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788970488.031248:0:17129:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788970488.034689:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309376 00000100:00100000:3.0:1788970488.034702:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309376 00000100:00100000:3.0:1788970488.034760:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970488.034769:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102309376:12345-0@lo:104: 00010000:00010000:3.0:1788970488.034788:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970488.034894:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970488.034901:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102309376:12345-0@lo:104: Request processed in 133us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970488.034908:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970488.040695:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102309376:0@lo:104: 00010000:00010000:0.0:1788970488.040729:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.044531:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970488.044545:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.044566:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970488.044571:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.044593:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970488.044600:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970488.044607:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970488.044655:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.044662:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970488.044682:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.044690:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fa05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa0c expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970488.044706:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970488.044707:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970488.044709:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970488.044761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102309504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970488.044822:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970488.045065:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309504 00000100:00100000:0.0:1788970488.045072:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309504 00010000:00010000:0.0:1788970488.045096:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 12 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970488.045129:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970488.045138:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+12:3650:x1875871102309504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970488.045149:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970488.045154:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 12 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045172:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 12 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045186:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654e00/0xc3abfebe76c6fa0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fa05 expref: 12 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045200:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045209:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788970488.045225:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014281431s 00010000:00010000:0.0:1788970488.045229:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045237:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045244:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045250:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045256:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970488.045260:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045268:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045289:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045299:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970488.045339:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+11:3650:x1875871102309504:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970488.045346:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788970488.045369:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045377:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970488.045399:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fa3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970488.046546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102309504:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788970488.056362:0:17129:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788970488.056962:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788970488.057625:0:17189:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788970488.057630:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788970488.058035:0:17190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788970488.058353:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788970488.059612:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788970488.060054:0:17191:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a7d836b0780 x1875871102309632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970488.060067:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000040:01000000:3.0:1788970488.060458:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788970488.060962:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788970488.063715:0:17129:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788970488.063736:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788970488.063939:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970488.067584:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788970488.068218:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788970488.068273:0:17190:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788970488.069314:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788970488.069363:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788970488.070700:0:17129:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788970488.071265:0:17129:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788970488.073937:0:17129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788970488.076045:0:17129:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788970488.076084:0:17129:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa287c1963988 00100000:10000000:0.0:1788970488.076092:0:17129:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788970488.077426:0:17129:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788970488.077442:0:17129:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788970488.077464:0:17129:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788970488.077505:0:17129:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788970488.078441:0:17129:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970488.078663:0:17129:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788970488.547895:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970489.056678:0:17184:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788970489.056694:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970489.058523:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788970489.058538:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788970489.116517:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:0.0:1788970489.565764:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788970489.638895:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788970489.638909:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7e92fc7000 from 7 10000000:01000000:1.0:1788970489.638915:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970489.638981:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970489.638995:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970489.639007:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970489.639052:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102309760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970489.639127:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970489.639245:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970489.642751:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309760 00000100:00100000:0.0:1788970489.642769:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309760 00000100:00100000:0.0:1788970489.642838:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970489.642864:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+11:17147:x1875871102309760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970489.642882:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970489.642901:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa44 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970489.642929:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970489.642939:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970489.642946:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013e00, rc 0) 00000100:00100000:0.0:1788970489.643025:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:17147:x1875871102309760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970489.643031:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970489.643119:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102309760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970489.643136:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970489.643145:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970489.643210:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102309888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788970489.643245:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970489.643283:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970489.644372:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309888 00000100:00100000:3.0:1788970489.644397:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309888 00000100:00100000:3.0:1788970489.644451:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970489.644462:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17147:x1875871102309888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788970489.644483:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970489.644504:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970489.644507:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788970489.644618:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17147:x1875871102309888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970489.644625:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970489.645784:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102309888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970489.645856:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970489.645874:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970489.645885:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970490.083757:0:17184:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788970490.083768:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970490.083932:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788970490.083988:0:17184:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970490.084154:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1788970490.145999:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:0.0:1788970490.588796:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970491.164458:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:1.0:1788970491.612728:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970492.189727:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000001:02000400:3.0:1788970492.226066:0:17434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788970492.636723:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970493.199523:0:17486:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970493.199815:0:17486:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788970493.212812:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970493.212819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788970493.212823:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788970493.212964:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102310016:0@lo:400:kworker.0 00000100:00100000:0.0:1788970493.213036:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970493.213137:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000100:00100000:0.0:1788970493.213734:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102310016 00000100:00100000:0.0:1788970493.213743:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102310016 00000100:00100000:0.0:1788970493.213788:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970493.213797:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:3651:x1875871102310016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970493.213855:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:3651:x1875871102310016:12345-0@lo:400:kworker.0 Request processed in 59us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970493.213861:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970493.213907:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102310016:0@lo:400:kworker.0 00000100:00080000:1.0:1788970493.214244:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:1.0:1788970493.214249:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970493.214257:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7ebf3b3800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970493.214285:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b12c0 x1875871102310144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970493.214313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970493.214317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970493.214320:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970493.214323:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970493.214326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970493.214329:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970493.214331:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970493.214337:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a7eb3da5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970493.214350:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b3840 x1875871102310272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970493.214472:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310144:0@lo:38:kworker.0 00000100:00100000:2.0:1788970493.214557:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970493.214590:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102310272:0@lo:38:kworker.0 00000100:00100000:2.0:1788970493.214614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970493.214792:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102310272 00000100:00100000:1.0:1788970493.214798:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102310272 00000100:00100000:1.0:1788970493.214832:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970493.214837:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102310272:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788970493.214859:0:17152:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1788970493.214893:0:17152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3abfebe76c6fa52 00000004:00100000:1.0:1788970493.214907:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788970493.215031:0:17152:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970493.215079:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875871102310272:12345-0@lo:38:kworker.0 Request processed in 240us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970493.215085:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788970493.215121:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7d836b3840 x1875871102310272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970493.215134:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788970493.215141:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788970493.215145:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788970493.215147:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788970493.215152:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102310272:0@lo:38:kworker.0 00000100:00100000:0.0:1788970493.216608:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102310144 00000100:00100000:0.0:1788970493.216620:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102310144 00000100:00100000:0.0:1788970493.216651:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970493.216658:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102310144:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788970493.216676:0:17156:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788970493.235128:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102310144:12345-0@lo:38:kworker.0 Request processed in 18461us (20562us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970493.235160:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788970493.237620:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970493.237630:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970493.237634:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310144:0@lo:38:kworker.0 00010000:00010000:1.0:1788970493.660623:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970494.023912:0:17536:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970494.024092:0:17536:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788970494.236757:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:0.0:1788970494.684661:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970495.261320:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:0.0:1788970495.716693:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970496.284823:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:1.0:1788970496.734423:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970497.312812:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970487/real 1788970487] req@ffff8a7d83568f00 x1875871102307200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970497.312845:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83568f00 x1875871102307200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970497.312878:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970487/real 1788970487] req@ffff8a7d83e870c0 x1875871102307072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970497.312892:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83e870c0 x1875871102307072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970497.312910:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970497.312929:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788970497.312933:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102307200:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788970497.312938:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970497.312944:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788970497.312947:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102307072:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788970497.313030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970497.313035:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788970497.313037:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970497.313042:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:1.0:1788970497.313047:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788970497.313057:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7ebf3b3800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970497.313077:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b0f00 x1875871102310528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970497.313091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970497.313094:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788970497.313096:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970497.313099:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:1.0:1788970497.313107:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970497.313113:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7eb145c000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970497.313126:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b2940 x1875871102310656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970497.313135:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970497.313138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788970497.313140:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970497.313142:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:1.0:1788970497.313145:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788970497.313148:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102310400:0@lo:400:kworker.0 00000100:00080000:1.0:1788970497.313151:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7ebf3b5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970497.313165:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b1a40 x1875871102310784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970497.313215:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102310912:0@lo:400:kworker.0 00000100:00100000:3.0:1788970497.313223:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970497.313296:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970497.313306:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102310400 00000100:00100000:3.0:1788970497.313314:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102310400 00000100:00100000:1.0:1788970497.313336:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310528:0@lo:38:kworker.0 00000100:00100000:3.0:1788970497.313363:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970497.313369:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970497.313377:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:3652:x1875871102310400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970497.313413:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310656:0@lo:8:kworker.0 00000400:00000100:1.0:1788970497.313437:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102310656 offset 0 length 520: 4 00000100:00100000:1.0:1788970497.313451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310784:0@lo:8:kworker.0 00000400:00000100:1.0:1788970497.313477:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102310784 offset 0 length 520: 4 00000100:00100000:3.0:1788970497.313478:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+12:3652:x1875871102310400:12345-0@lo:400:kworker.0 Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970497.313490:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970497.313505:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102310528 00000100:00100000:1.0:1788970497.313522:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102310528 00000100:00100000:1.0:1788970497.313550:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970497.313555:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102310528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788970497.313580:0:17155:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970497.313727:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102310912 00000100:00100000:3.0:1788970497.313731:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102310912 00000100:00100000:3.0:1788970497.313757:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970497.313764:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102310912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970497.313816:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102310912:12345-0@lo:400:kworker.0 Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970497.313822:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970497.313866:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102310400:0@lo:400:kworker.0 00010000:00080000:3.0:1788970497.313913:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7d836b3840 x1875871102310912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970497.313924:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102310912:0@lo:400:kworker.0 00000100:00100000:0.0:1788970497.315598:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000100:00100000:0.0:1788970497.336450:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102310528:12345-0@lo:38:kworker.0 Request processed in 22885us (23077us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970497.336464:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788970497.336656:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970497.336663:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970497.336668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310528:0@lo:38:kworker.0 00010000:00010000:1.0:1788970497.756763:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970498.337991:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:1.0:1788970498.781336:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970499.356670:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:0.0:1788970499.807085:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788970500.300842:0:17881:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788970500.300846:0:17881:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788970500.300847:0:17881:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788970500.300967:0:17881:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7ebf423000 00000020:01000004:1.0:1788970500.300982:0:17881:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788970500.300994:0:17881:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788970500.301009:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a7eb3dc3380) 00000020:00000080:1.0:1788970500.301025:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000040:00080000:2.0:1788970500.326133:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788970500.380566:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00100000:10000000:2.0:1788970500.389198:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788970500.390150:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.392739:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.392956:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.394083:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.395058:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.395260:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.395802:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.396132:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.396575:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.396798:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.397093:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.397348:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.397764:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.398091:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.398640:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.399227:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.400143:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.401312:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.402098:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.402326:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788970500.403296:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.403811:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788970500.403975:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.407591:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.409196:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.409643:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788970500.409849:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788970500.410537:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.411192:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.411538:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788970500.412316:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.413248:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788970500.413575:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788970500.418134:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788970500.419125:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788970500.419375:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788970500.420466:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788970500.421100:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788970500.421657:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788970500.422227:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788970500.423106:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788970500.423564:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788970500.423786:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788970500.424287:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788970500.425294:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:3.0:1788970500.427897:0:17881:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788970500.428126:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788970500.428137:0:17881:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788970500.428148:0:17881:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6fa60 00000020:01000004:3.0:1788970500.428154:0:17881:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788970500.428174:0:17881:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788970500.428177:0:17881:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788970500.428183:0:17881:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788970500.428210:0:17881:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788970500.428213:0:17881:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788970500.439736:0:17881:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788970500.439777:0:17881:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788970500.439782:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788970500.439783:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970500.439785:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970500.439786:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970500.439787:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970500.439788:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970500.439789:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970500.439791:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970500.439792:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788970500.439795:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788970500.439797:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788970500.439799:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970500.439800:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970500.439801:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970500.439802:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970500.439808:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970500.439809:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970500.439810:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970500.439810:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788970500.439846:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788970500.439867:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788970500.439935:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.440033:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.441196:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311040 00000100:00100000:3.0:1788970500.441219:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311040 00000100:00100000:3.0:1788970500.441276:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970500.441287:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17881:x1875871102311040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788970500.441318:0:17143:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788970500.441321:0:17143:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788970500.441329:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788970500.444088:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17881:x1875871102311040:12345-0@lo:253:mount.lustre.0 Request processed in 2795us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.444101:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970500.444218:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311040:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970500.444233:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788970500.444236:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970500.444238:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970500.444240:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970500.444241:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970500.444242:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970500.444244:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970500.444245:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970500.444247:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970500.444248:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970500.444762:0:17881:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7ebf423000 from lustre-MDT0001 10000000:01000000:0.0:1788970500.444795:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788970500.444798:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788970500.444805:0:17881:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7d83390000 local copy 00010000:00010000:0.0:1788970500.444814:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970500.445030:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970500.445077:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.445142:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.445175:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311168 00000100:00100000:3.0:1788970500.445182:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311168 00000100:00100000:3.0:1788970500.445249:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970500.445374:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:17881:x1875871102311168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970500.445608:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+12:17881:x1875871102311168:12345-0@lo:501:mount.lustre.0 Request processed in 238us (529us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970500.445616:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970500.445633:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311168:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788970500.445646:0:17881:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788970500.445665:0:17881:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788970500.445672:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.445681:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.445709:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7ebf423000 10000000:01000000:1.0:1788970500.445714:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788970500.445717:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a7d83390000 10000000:01000000:1.0:1788970500.445720:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788970500.445723:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a7d83390000 from 1 10000000:01000000:1.0:1788970500.445738:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788970500.445763:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.445770:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.445778:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.445790:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970500.445819:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.445847:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.445902:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311296 00000100:00100000:2.0:1788970500.445907:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311296 00000100:00100000:2.0:1788970500.445940:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970500.445948:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+12:17881:x1875871102311296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970500.445956:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970500.445967:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9400/0xc3abfebe76c6fa6e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa67 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.446055:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9400/0xc3abfebe76c6fa6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa67 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.446065:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9400/0xc3abfebe76c6fa6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa67 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.446073:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9400, rc 0) 00000100:00100000:2.0:1788970500.446153:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+13:17881:x1875871102311296:12345-0@lo:101:mount.lustre.0 Request processed in 205us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.446160:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970500.448980:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970500.449107:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.449120:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.449144:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788970500.449188:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.449196:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.449206:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a7ebf423000 10000000:01000000:1.0:1788970500.449213:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788970500.449230:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a7ebf423000 from 1 10000000:01000000:1.0:1788970500.449232:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788970500.449265:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.449274:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.449283:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.449301:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970500.449358:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.449431:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.449594:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311424 00000100:00100000:2.0:1788970500.449601:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311424 00000100:00100000:2.0:1788970500.449653:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970500.449662:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+13:17881:x1875871102311424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970500.449674:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970500.449686:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c6fa7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa75 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.449703:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c6fa7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa75 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.449711:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c6fa7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa75 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.449718:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8e00, rc 0) 00000100:00100000:2.0:1788970500.449761:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+14:17881:x1875871102311424:12345-0@lo:101:mount.lustre.0 Request processed in 99us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.449766:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970500.451098:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970500.451118:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.451126:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.451141:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788970500.451160:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.451168:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.451174:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788970500.451190:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970500.451195:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a7ebf423000 10000000:01000000:1.0:1788970500.451197:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788970500.451201:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788970500.451203:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788970500.451227:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.451234:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.451242:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.451258:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970500.451300:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.451578:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.451656:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311552 00000100:00100000:3.0:1788970500.451663:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311552 00000100:00100000:3.0:1788970500.451755:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970500.451764:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+14:17881:x1875871102311552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970500.451774:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970500.451785:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c6fa8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fa83 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.451803:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c6fa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa83 expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.451811:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c6fa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa83 expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.451833:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:3.0:1788970500.451874:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311552:12345-0@lo:101:mount.lustre.0 Request processed in 112us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.451880:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970500.451949:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970500.451960:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.451968:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970500.453332:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788970500.453912:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970500.458008:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788970500.458061:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788970500.458080:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788970500.458094:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788970500.458117:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788970500.458137:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788970500.458150:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788970500.458163:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788970500.458173:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788970500.458184:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788970500.458198:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788970500.458211:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788970500.458224:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788970500.458235:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788970500.458248:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788970500.458262:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788970500.458276:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788970500.458291:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788970500.458303:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788970500.458313:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788970500.458324:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788970500.458338:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788970500.458351:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788970500.458375:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788970500.458412:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788970500.458525:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970500.458583:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.458619:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.459158:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311680 00000100:00100000:3.0:1788970500.459165:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311680 00000100:00100000:3.0:1788970500.459217:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970500.459226:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970500.459561:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311680:12345-0@lo:501:mount.lustre.0 Request processed in 335us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.459569:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788970500.459766:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970500.459802:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970500.459849:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.459914:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.459948:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311808 00000100:00100000:3.0:1788970500.459952:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311808 00000100:00100000:3.0:1788970500.459986:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970500.460099:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970500.461063:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311808:12345-0@lo:503:mount.lustre.0 Request processed in 964us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.461072:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788970500.461143:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788970500.461956:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970500.462035:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970500.462088:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.462129:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.462195:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102311936 00000100:00100000:3.0:1788970500.462200:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102311936 00000100:00100000:3.0:1788970500.462442:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970500.462454:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970500.463616:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102311936:12345-0@lo:502:mount.lustre.0 Request processed in 800us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.463628:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788970500.463781:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102311936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970500.463987:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788970500.464018:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788970500.464033:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788970500.464049:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788970500.464064:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788970500.464078:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788970500.464092:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788970500.464104:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788970500.464117:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788970500.464132:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788970500.464147:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788970500.464161:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788970500.464173:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788970500.464184:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788970500.464194:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788970500.464208:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788970500.464225:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788970500.464238:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788970500.464249:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788970500.464288:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788970500.464302:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788970500.464316:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788970500.464329:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788970500.464342:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788970500.464352:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788970500.464375:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788970500.464631:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788970500.464647:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788970500.464658:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788970500.464668:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788970500.464682:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788970500.464696:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788970500.464709:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788970500.464720:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788970500.464730:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788970500.464742:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788970500.464756:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788970500.464768:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788970500.464779:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788970500.464790:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788970500.464801:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788970500.464816:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788970500.464829:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788970500.464843:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788970500.464880:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102312064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970500.464944:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.465542:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebbb9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.465669:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102312064 00000100:00100000:2.0:1788970500.465677:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102312064 00000100:00100000:0.0:1788970500.465738:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970500.465749:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102312064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970500.465873:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102312064:12345-0@lo:502:mount.lustre.0 Request processed in 126us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970500.465886:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788970500.465969:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102312064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970500.466024:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788970500.466034:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788970500.466950:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970500.466962:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.466964:0:17885:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788970500.466969:0:17885:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788970500.466972:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970500.466987:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a7e8828b380) 00000020:00000080:1.0:1788970500.467013:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788970500.467019:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788970500.467098:0:17885:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788970500.467105:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6fa98 00000020:00000080:1.0:1788970500.467688:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788970500.467693:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970500.467698:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.467700:0:17885:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788970500.467703:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970500.467707:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.467708:0:17885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788970500.467712:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970500.467721:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a7e8828cd40) 00000020:00000080:1.0:1788970500.467733:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788970500.467738:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788970500.467739:0:17885:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788970500.467742:0:17885:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788970500.467748:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788970500.467809:0:17885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7ebf423000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788970500.467822:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a7e882899c0) 00000020:00000080:1.0:1788970500.467831:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788970500.467890:0:17885:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788970500.467896:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6faad 00000020:00000080:1.0:1788970500.468014:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788970500.468021:0:17885:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788970500.468025:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc3abfebe76c6fab4 00080000:01000000:1.0:1788970500.468031:0:17885:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788970500.468035:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6fabb 00010000:00010000:3.0:1788970500.534099:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788970500.534756:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788970500.535234:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788970500.536582:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788970500.536594:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970500.536600:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.536602:0:17885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788970500.536606:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970500.536616:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.536617:0:17885:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788970500.536620:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788970500.536625:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:1.0:1788970500.536651:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970500.536665:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a7e88288000) 00000020:00000080:1.0:1788970500.536683:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788970500.536687:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788970500.536747:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788970500.536753:0:17885:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788970500.536759:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6fac9 00010000:00080000:1.0:1788970500.536788:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7e88b2f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970500.539904:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788970500.542446:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788970500.542462:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788970500.542521:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788970500.542544:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6fad0 00000100:00080000:2.0:1788970500.542554:0:17885:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970500.542563:0:17885:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7e88b2f800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970500.542598:0:17885:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf514780 x1875871102312192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970500.542624:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788970500.542681:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970500.542685:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970500.542686:0:17885:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788970500.542689:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788970500.542692:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788970500.542694:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970500.542695:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970500.542697:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788970500.542699:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970500.542701:0:17885:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788970500.542703:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970500.542708:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970500.542709:0:17885:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788970500.542712:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788970500.542739:0:17885:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788970500.542752:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970500.542760:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970500.542762:0:17885:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788970500.542765:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788970500.542767:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788970500.542768:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970500.542769:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970500.542770:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788970500.542772:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970500.542774:0:17885:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788970500.542776:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970500.542779:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788970500.542781:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970500.542782:0:17885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788970500.542785:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788970500.542788:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1788970500.542806:0:17885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788970500.542808:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970500.542819:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a7ebd8eb380) 00000020:00000080:2.0:1788970500.542829:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788970500.542833:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788970500.542895:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788970500.542903:0:17885:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788970500.542909:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6fade 00010000:00080000:2.0:1788970500.542932:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7eb3da2000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.115@tcp at head 00000100:00100000:1.0:1788970500.543027:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102312192:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788970500.543074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788970500.543079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788970500.543081:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970500.543085:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 516 00000100:00100000:1.0:1788970500.543087:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970500.543089:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00010000:00010000:2.0:1788970500.545248:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788970500.546775:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7ebf3b3800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970500.546813:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e84f00 x1875871102312320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970500.546829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970500.546833:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970500.546836:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970500.546839:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970500.546893:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102312448:0@lo:400:kworker.0 00000100:00100000:2.0:1788970500.546950:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.547148:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102312448 00000100:00100000:0.0:1788970500.547157:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102312448 00000100:00100000:0.0:1788970500.547208:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970500.547217:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970500.547452:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102312448:12345-0@lo:400:kworker.0 Request processed in 235us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970500.547460:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788970500.547603:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7d83e85a40 x1875871102312448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970500.547617:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102312448:0@lo:400:kworker.0 00000040:01000000:3.0:1788970500.547768:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788970500.548524:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102312192 00000100:00100000:0.0:1788970500.548532:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102312192 00000100:00100000:0.0:1788970500.548560:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970500.548566:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102312192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788970500.548590:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1788970500.548622:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6fae5 00000004:00100000:0.0:1788970500.548637:0:17156:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788970500.548643:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1788970500.551076:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788970500.551109:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102312320:0@lo:38:kworker.0 00000100:00100000:1.0:1788970500.551168:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.551374:0:17155:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788970500.551511:0:17155:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788970500.551875:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102312320 00000100:00100000:0.0:1788970500.551884:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102312320 00000100:00100000:3.0:1788970500.552021:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970500.552029:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102312320:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788970500.552124:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102312320:12345-0@lo:38:kworker.0 Request processed in 94us (954us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788970500.552132:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970500.552161:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970500.552170:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970500.552174:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788970500.552177:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102312320:0@lo:38:kworker.0 00000100:00080000:0.0:1788970500.553855:0:17156:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970500.553947:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102312192:12345-0@lo:38:llog_process_th.0 Request processed in 5378us (10858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970500.553957:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970500.554148:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970500.554156:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788970500.554163:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788970500.554168:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788970500.554170:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788970500.554181:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102312192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970500.554302:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970500.554315:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102312576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970500.554356:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.554412:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102312576 00000100:00100000:3.0:1788970500.554423:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102312576 00000100:00100000:3.0:1788970500.554458:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970500.554467:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875871102312576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970500.554504:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788970500.554550:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875871102312576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.554557:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970500.554597:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102312576:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788970500.554768:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970500.555141:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788970500.555444:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000020:00000080:1.0:1788970500.557860:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970500.557873:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788970500.557914:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788970500.557934:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6faec 00000100:00080000:1.0:1788970500.557943:0:17885:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970500.557952:0:17885:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7eb3da2000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970500.557987:0:17885:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d836b21c0 x1875871102312704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970500.558013:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788970500.558122:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970500.558126:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.558128:0:17885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788970500.558131:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788970500.558134:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788970500.558136:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970500.558137:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970500.558139:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788970500.558141:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.558142:0:17885:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788970500.558145:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788970500.558149:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788970500.558152:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970500.558153:0:17885:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788970500.558161:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788970500.558165:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:1.0:1788970500.558185:0:17885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788970500.558187:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970500.558199:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a7eae150000) 00000020:00000080:1.0:1788970500.558210:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788970500.558215:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788970500.558291:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788970500.558298:0:17885:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788970500.558303:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c6fafa 00010000:00080000:1.0:1788970500.558329:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf505000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1788970500.558562:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788970500.558625:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788970500.558639:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788970500.558834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102312704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788970500.558880:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102312704 offset 0 length 520: 4 00000040:00080000:2.0:1788970500.559092:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970500.559096:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:3.0:1788970500.559218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970500.559223:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970500.559226:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970500.559236:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788970500.560942:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970500.563186:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788970500.563604:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788970500.564340:0:17893:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788970500.564346:0:17893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788970500.565427:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970500.565437:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788970500.565476:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788970500.565529:0:17885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6fb01 00000100:00080000:0.0:1788970500.565539:0:17885:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970500.565551:0:17885:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebf505000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970500.565587:0:17885:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83568000 x1875871102312832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970500.565608:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788970500.565632:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102312832:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1788970500.565666:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.565671:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.565672:0:17885:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788970500.565675:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970500.565678:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.565680:0:17885:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000400:00000100:1.0:1788970500.565682:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102312832 offset 0 length 520: 4 00000020:00000080:0.0:1788970500.565683:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970500.565685:0:17885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788970500.565687:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.565690:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.565691:0:17885:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788970500.565693:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970500.565695:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.565696:0:17885:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970500.565699:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788970500.565725:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.565728:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.565729:0:17885:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788970500.565733:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788970500.565811:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788970500.565840:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788970500.565865:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.565876:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.565884:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebf423000 from 1 10000000:01000000:1.0:1788970500.565887:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970500.565911:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.565920:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.565930:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788970500.565956:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788970500.565957:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102312960:0@lo:101:mount.lustre.0 00000100:00080000:3.0:1788970500.565961:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970500.565963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970500.565966:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970500.566198:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.566221:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.566480:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102312960 00000100:00100000:3.0:1788970500.566494:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102312960 00000100:00100000:3.0:1788970500.566571:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970500.566580:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+15:17881:x1875871102312960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970500.566592:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970500.566604:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb08 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.566625:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.566637:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.566645:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:3.0:1788970500.566695:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+16:17881:x1875871102312960:12345-0@lo:101:mount.lustre.0 Request processed in 117us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.566702:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970500.566776:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102312960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970500.566789:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.566797:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.567331:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313088:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788970500.567369:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.567697:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970500.567770:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313088 00000100:00100000:0.0:1788970500.567783:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313088 00000100:00100000:0.0:1788970500.567810:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788970500.567817:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+16:17881:x1875871102313088:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788970500.567842:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788970500.567856:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788970500.567859:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788970500.567952:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+16:17881:x1875871102313088:12345-0@lo:256:mount.lustre.0 Request processed in 135us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970500.567959:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788970500.568117:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313088:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788970500.568723:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970500.568738:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.568747:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970500.568754:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebf423000 from 1 10000000:01000000:1.0:1788970500.568757:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970500.568779:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.568796:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.568805:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.568821:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970500.568854:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.568870:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970500.569017:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313216 00000100:00100000:0.0:1788970500.569023:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313216 00000100:00100000:0.0:1788970500.569049:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788970500.569057:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+16:17881:x1875871102313216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970500.569065:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970500.569075:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb16 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.569096:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.569105:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.569113:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013000, rc 0) 00000100:00100000:0.0:1788970500.569142:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313216:12345-0@lo:101:mount.lustre.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970500.569149:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970500.569283:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970500.569294:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.569302:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970500.569749:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970500.569783:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970500.569818:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.569884:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.569917:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313344 00000100:00100000:2.0:1788970500.569922:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313344 00000100:00100000:2.0:1788970500.569987:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788970500.569995:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970500.570085:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313344:12345-0@lo:501:mount.lustre.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.570092:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788970500.570144:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970500.570171:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970500.570208:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.570268:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b18cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.570335:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313472 00000100:00100000:3.0:1788970500.570345:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313472 00000100:00100000:3.0:1788970500.570364:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970500.570369:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970500.570471:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313472:12345-0@lo:503:mount.lustre.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.570478:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970500.570652:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788970500.570960:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970500.571019:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970500.571055:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.571076:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b18000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.571138:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313600 00000100:00100000:3.0:1788970500.571143:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313600 00000100:00100000:3.0:1788970500.571162:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970500.571167:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970500.571239:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313600:12345-0@lo:502:mount.lustre.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.571246:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788970500.571317:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970500.571531:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788970500.571558:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788970500.571587:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788970500.571600:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788970500.571611:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788970500.571625:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788970500.571638:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788970500.571650:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788970500.571660:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788970500.571670:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788970500.571684:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788970500.571703:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970500.571733:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.571749:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b18000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.571864:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313728 00000100:00100000:3.0:1788970500.571869:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313728 00000100:00100000:3.0:1788970500.571888:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788970500.571894:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970500.571964:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313728:12345-0@lo:502:mount.lustre.0 Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.571970:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970500.572147:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970500.572183:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788970500.572191:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788970500.572793:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970500.572802:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.572805:0:17895:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788970500.572811:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7ebf423000 00000020:00000080:0.0:1788970500.572814:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970500.572821:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.572824:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.572825:0:17895:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788970500.572827:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970500.572829:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.572830:0:17895:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788970500.572833:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7ebf423000 00000020:00000080:0.0:1788970500.572835:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970500.572925:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.572929:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.572930:0:17895:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788970500.572933:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970500.572935:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.572936:0:17895:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788970500.572940:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7ebf423000 00000020:00000080:0.0:1788970500.572942:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970500.578687:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.578714:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.578716:0:17895:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788970500.578721:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970500.578725:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.578726:0:17895:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788970500.578732:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7ebf423000 00000020:00000080:0.0:1788970500.578734:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970500.578800:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970500.578804:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970500.578805:0:17895:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788970500.578809:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788970500.581559:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788970500.581620:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970500.581642:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.581655:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970500.581720:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788970500.581723:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7ebf423000 10000000:01000000:3.0:1788970500.581726:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7ebf423000 10000000:01000000:3.0:1788970500.581731:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970500.581736:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7ebf423000 from 1 10000000:01000000:3.0:1788970500.581739:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970500.581772:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.581780:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.581790:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970500.581811:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970500.581870:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.581910:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313856 00000100:00100000:3.0:1788970500.581916:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313856 00000100:00100000:3.0:1788970500.581953:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970500.581961:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17881:x1875871102313856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970500.581973:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970500.581984:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c6fb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb24 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.582019:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c6fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb24 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.582038:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c6fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb24 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.582046:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655400, rc 0) 00000100:00100000:3.0:1788970500.582077:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102313856:12345-0@lo:101:mount.lustre.0 Request processed in 116us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.582083:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970500.582122:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d824490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.582141:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970500.582154:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970500.582163:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970500.585371:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788970500.585806:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970500.586017:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788970500.586043:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788970500.586057:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788970500.586071:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788970500.586085:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788970500.586097:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788970500.586111:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788970500.586137:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788970500.586159:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788970500.586173:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788970500.586186:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788970500.586212:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788970500.586226:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788970500.586239:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788970500.586252:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788970500.586265:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788970500.586278:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788970500.586292:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788970500.586304:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788970500.586316:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788970500.586329:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788970500.586342:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788970500.586355:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788970500.589524:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788970500.589581:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788970500.589594:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788970500.589606:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788970500.589618:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788970500.589642:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788970500.589647:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788970500.589741:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970500.589803:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.589841:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.589928:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102313984 00000100:00100000:2.0:1788970500.589936:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102313984 00000100:00100000:2.0:1788970500.589983:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788970500.589993:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102313984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970500.590116:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102313984:12345-0@lo:501:mount.lustre.0 Request processed in 124us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.590124:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970500.590204:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102313984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970500.590229:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970500.590265:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.590320:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.591974:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314112 00000100:00100000:2.0:1788970500.591985:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314112 00000100:00100000:2.0:1788970500.592033:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788970500.592105:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970500.592667:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314112:12345-0@lo:503:mount.lustre.0 Request processed in 624us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.592676:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788970500.592680:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970500.593044:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970500.593109:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970500.593152:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.593187:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d824490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970500.593502:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314240 00000100:00100000:1.0:1788970500.593509:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314240 00000100:00100000:1.0:1788970500.593555:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970500.593563:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970500.593668:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314240:12345-0@lo:502:mount.lustre.0 Request processed in 105us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970500.593675:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788970500.593774:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970500.593944:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788970500.593970:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788970500.593984:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788970500.593997:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788970500.594008:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788970500.594019:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788970500.594030:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788970500.594042:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788970500.594072:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788970500.594089:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788970500.594105:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788970500.594117:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788970500.594130:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788970500.594146:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788970500.594158:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788970500.594171:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788970500.594185:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788970500.594198:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788970500.594211:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788970500.594225:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788970500.594238:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788970500.594253:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788970500.594266:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788970500.594279:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788970500.594305:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788970500.594320:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788970500.594332:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788970500.594344:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788970500.594368:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788970500.596093:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788970500.596144:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788970500.596161:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788970500.596177:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788970500.596192:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788970500.596340:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788970500.596362:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788970500.596378:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788970500.596503:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788970500.596525:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788970500.596546:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788970500.596580:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788970500.596597:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788970500.596614:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788970500.596632:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788970500.596651:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788970500.596668:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788970500.596684:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788970500.596699:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788970500.596755:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970500.596895:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970500.596942:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314368 00000100:00100000:3.0:1788970500.596946:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d824490c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.596951:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314368 00000100:00100000:2.0:1788970500.596998:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788970500.597008:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970500.597124:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314368:12345-0@lo:502:mount.lustre.0 Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.597131:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788970500.597522:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970500.597712:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788970500.597736:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788970500.597759:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970500.597796:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.598117:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314496 00000100:00100000:1.0:1788970500.598123:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314496 00000100:00100000:1.0:1788970500.598157:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788970500.598164:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970500.598261:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314496:12345-0@lo:502:mount.lustre.0 Request processed in 97us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970500.598268:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788970500.598541:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d824490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.598559:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970500.598612:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788970500.598623:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788970500.603678:0:17900:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788970500.603697:0:17900:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a7eae093380) 00000020:00000080:0.0:1788970500.603720:0:17900:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788970500.603830:0:17900:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7ebf423000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788970500.603835:0:17900:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7ebf423000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788970500.603837:0:17900:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebf423000 3 00010000:00080000:0.0:1788970500.603877:0:17900:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7eaa732800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970500.605736:0:17900:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788970500.605924:0:17900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788970500.605961:0:17900:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970500.605973:0:17900:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc3abfebe76c6fb39 00000100:00080000:0.0:1788970500.605983:0:17900:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970500.605993:0:17900:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a7eaa732800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970500.606027:0:17900:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d835692c0 x1875871102314624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970500.606057:0:17900:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788970500.606084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970500.606089:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970500.606091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970500.606094:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970500.607463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102314624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970500.607550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.607627:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314624 00000100:00100000:1.0:1788970500.607635:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314624 00000100:00100000:1.0:1788970500.607666:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970500.607672:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102314624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788970500.607696:0:17152:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1788970500.607728:0:17152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc3abfebe76c6fb40 00000004:00100000:1.0:1788970500.607741:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788970500.607769:0:17152:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970500.607815:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875871102314624:12345-0@lo:38:llog_process_th.0 Request processed in 142us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970500.607821:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788970500.607857:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7d835692c0 x1875871102314624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970500.607867:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970500.607874:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788970500.607880:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788970500.607884:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788970500.607887:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788970500.607891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102314624:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788970500.611661:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1788970500.611722:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788970500.611752:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788970500.611767:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.611785:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788970500.611833:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788970500.611836:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970500.611837:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970500.611838:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970500.611840:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970500.611841:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970500.611843:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970500.611845:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970500.611846:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788970500.611850:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788970500.611852:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788970500.611853:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970500.611854:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970500.611855:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970500.611856:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970500.611857:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970500.611858:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970500.611859:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970500.611860:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788970500.611885:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788970500.611905:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788970500.611972:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970500.612008:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b18e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970500.613708:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314752 00000100:00100000:1.0:1788970500.613726:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314752 00000100:00100000:1.0:1788970500.613793:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788970500.613804:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788970500.613848:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788970500.613862:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788970500.616214:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788970500.616270:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788970500.616310:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788970500.616598:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17881:x1875871102314752:12345-0@lo:253:mount.lustre.0 Request processed in 2794us (4624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970500.616609:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 20000000:01000000:0.0:1788970500.616820:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970500.616825:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1788970500.616905:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:17881:1875871102314752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970500.616918:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788970500.616923:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970500.616934:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970500.616935:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970500.616937:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970500.616938:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970500.616939:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970500.616940:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970500.616942:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970500.616943:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788970500.616958:0:17881:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788970500.618585:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.618606:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.618613:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.618619:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.618656:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.618670:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 17 pid: 17143 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.618683:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102314880:0@lo:104: 00000100:00100000:1.0:1788970500.618738:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970500.618842:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970500.618851:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 17 pid: 17145 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970500.618859:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102315008:0@lo:104: 00000100:00100000:1.0:1788970500.618880:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970500.620666:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82160e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970500.621633:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102314880 00000100:00100000:2.0:1788970500.621643:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102314880 00000100:00100000:2.0:1788970500.621679:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315008 00000100:00100000:2.0:1788970500.621682:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315008 00000100:00100000:2.0:1788970500.621699:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970500.621708:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+4:17166:x1875871102314880:12345-0@lo:104: 00010000:00010000:2.0:1788970500.621723:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.621851:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970500.621857:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+4:17166:x1875871102314880:12345-0@lo:104: Request processed in 151us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.621864:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970500.621879:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970500.621885:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102315008:12345-0@lo:104: 00010000:00010000:2.0:1788970500.621893:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.621930:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788970500.621935:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102315008:12345-0@lo:104: Request processed in 51us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.621952:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788970500.622129:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970500.622135:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622143:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970500.622147:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622156:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970500.622164:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970500.622169:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970500.622201:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622207:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970500.622226:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622233:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2400/0xc3abfebe76c6fb08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb0f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622246:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970500.622249:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622266:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970500.622269:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622276:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970500.622281:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970500.622286:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970500.622300:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622306:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970500.622321:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622328:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c6fa44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa4b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622341:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970500.622343:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970500.622345:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970500.622351:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970500.622372:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102315136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970500.622519:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970500.622569:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102315264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970500.622602:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970500.622637:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315136 00000100:00100000:2.0:1788970500.622642:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315136 00010000:00010000:2.0:1788970500.622662:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 18 pid: 17143 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970500.622681:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315264 00000100:00100000:2.0:1788970500.622684:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315264 00010000:00010000:2.0:1788970500.622695:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 19 pid: 17145 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970500.622706:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970500.622711:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+19:3652:x1875871102315136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970500.622720:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970500.622725:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 19 pid: 17143 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622735:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 19 pid: 17143 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622751:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970500.622776:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+19:3652:x1875871102315136:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.622782:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970500.622794:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970500.622801:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+18:3649:x1875871102315264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970500.622808:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970500.622813:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 18 pid: 17145 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622832:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 18 pid: 17145 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622843:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622851:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970500.622865:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014281431s 00010000:00010000:2.0:1788970500.622870:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622878:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622883:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622889:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622894:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970500.622898:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622905:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622914:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970500.622931:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970500.622958:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+18:3649:x1875871102315264:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970500.622965:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970500.623004:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102315136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970500.623027:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102315264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970500.623327:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655a00/0xc3abfebe76c6fb0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fb08 expref: 17 pid: 17143 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970500.623336:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102314880:0@lo:104: 00010000:00010000:0.0:1788970500.623345:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae013e00/0xc3abfebe76c6fa4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fa44 expref: 16 pid: 17145 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970500.623352:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b30c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102315008:0@lo:104: 00010000:00010000:0.0:1788970500.623367:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.623375:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.624028:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970500.624034:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c6fb47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788970500.625128:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788970500.625352:0:17906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788970500.625480:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788970500.625940:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970500.627606:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875871102315392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788970500.627642:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788970500.627679:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788970500.627683:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970500.627709:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449c00 going to sleep for 11 seconds 00000004:00000080:0.0:1788970500.628123:0:17881:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788970500.628139:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788970500.628174:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970500.629267:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788970500.629349:0:17906:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1788970500.629521:0:17905:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788970500.629526:0:17905:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788970500.630336:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788970500.631712:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315392 00000100:00100000:3.0:1788970500.631724:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315392 00000100:00100000:3.0:1788970500.631771:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970500.631781:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17907:x1875871102315392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788970500.631911:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17907:x1875871102315392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 132us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.631919:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970500.631967:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875871102315392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788970500.632012:0:17907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788970500.632048:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875871102315520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788970500.632085:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.632108:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315520 00000100:00100000:3.0:1788970500.632112:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315520 00000100:00100000:3.0:1788970500.632132:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970500.632138:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17907:x1875871102315520:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788970500.632168:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788970500.632218:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788970500.632237:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17907:x1875871102315520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.632244:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970500.632265:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.632278:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875871102315520:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788970500.632316:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970500.632425:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17907:1875871102315648:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788970500.632453:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.632473:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449840 going to sleep for 11 seconds 00080000:10000000:0.0:1788970500.632948:0:17881:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1788970500.633548:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315648 00000100:00100000:1.0:1788970500.633556:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315648 00000100:00100000:1.0:1788970500.633592:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970500.633601:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1875871102315648:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788970500.633677:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1875871102315648:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970500.633684:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788970500.634169:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7d83e84b40 x1875871102315648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970500.634182:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17907:1875871102315648:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788970500.634248:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875871102315776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788970500.634280:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970500.634306:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315776 00000100:00100000:3.0:1788970500.634310:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315776 00000100:00100000:3.0:1788970500.634337:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970500.634344:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1875871102315776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788970500.634414:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1875871102315776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970500.634421:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970500.634444:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970500.634457:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875871102315776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788970500.634511:0:17907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1788970500.634840:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:3.0:1788970500.639954:0:17907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788970500.640054:0:17907:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788970500.640060:0:17907:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788970500.640209:0:17881:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788970500.640232:0:17881:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa287c558b988 00100000:10000000:0.0:1788970500.640241:0:17881:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788970500.640981:0:17881:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788970500.641008:0:17881:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788970500.641026:0:17881:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788970500.641053:0:17881:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788970500.657293:0:17881:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970500.659768:0:17881:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970500.834043:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970501.411451:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 10000000:01000000:2.0:1788970501.660933:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788970501.660940:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebf423000 from 8 10000000:01000000:2.0:1788970501.660945:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970501.661002:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970501.661015:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970501.661025:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970501.661051:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102315904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970501.661111:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970501.661198:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970501.661372:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102315904 00000100:00100000:0.0:1788970501.661396:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102315904 00000100:00100000:0.0:1788970501.661438:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788970501.661446:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+16:17147:x1875871102315904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970501.661459:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970501.661472:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb4e expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970501.661506:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970501.661515:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970501.661535:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012400, rc 0) 00000100:00100000:0.0:1788970501.661635:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102315904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970501.661641:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000040:00080000:2.0:1788970501.666031:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970501.666564:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102315904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970501.666646:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970501.666658:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970501.666789:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102316032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788970501.666846:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970501.666894:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8215d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970501.666971:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316032 00000100:00100000:2.0:1788970501.666978:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316032 00000100:00100000:2.0:1788970501.667104:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788970501.667115:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102316032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788970501.667134:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970501.667149:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970501.667152:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788970501.667243:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102316032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970501.667251:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970501.667321:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102316032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788970501.667374:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970501.667412:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970501.667427:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970501.667437:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788970501.667440:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7e92fc7000 from 8 10000000:01000000:3.0:1788970501.667442:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970501.667464:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970501.667471:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970501.667491:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970501.667507:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102316160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970501.667532:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970501.675738:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970501.676043:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316160 00000100:00100000:1.0:1788970501.676052:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316160 00000100:00100000:1.0:1788970501.676105:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970501.676114:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102316160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970501.676130:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970501.676148:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb5c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970501.676177:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970501.676188:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970501.676197:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3e00, rc 0) 00000100:00100000:1.0:1788970501.676271:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102316160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (8737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970501.676279:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788970501.676500:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102316160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970501.676517:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970501.676527:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970501.676593:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102316288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788970501.676929:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970501.677008:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970501.677091:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316288 00000100:00100000:1.0:1788970501.677096:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316288 00000100:00100000:1.0:1788970501.677118:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970501.677125:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102316288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788970501.677139:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788970501.677154:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788970501.677157:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788970501.678087:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102316288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 958us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970501.678096:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788970501.678362:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102316288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788970501.678423:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970501.678431:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970501.678441:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970501.856866:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970502.431506:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000040:00080000:2.0:1788970502.685777:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788970502.876566:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970503.456222:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00010000:00010000:0.0:1788970503.906954:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970504.480451:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000001:02000400:1.0:1788970504.756011:0:18150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788970504.924518:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970505.500760:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 0 seconds 00000020:00000004:3.0:1788970505.565446:0:18202:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970505.567904:0:18202:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788970505.949860:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970506.013099:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102316416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970506.013168:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970506.013401:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788970506.013406:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788970506.013409:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970506.013421:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7ebf3b3800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970506.013464:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e843c0 x1875871102316672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970506.013479:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970506.013483:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970506.013486:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970506.013489:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970506.013512:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970506.013522:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970506.013525:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970506.013528:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970506.013530:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316416 00000100:00100000:1.0:1788970506.013551:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316416 00000100:00100000:3.0:1788970506.013561:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102316800:0@lo:400:kworker.0 00000100:00100000:3.0:1788970506.013597:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970506.013601:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970506.013612:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102316416:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970506.013623:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970506.013631:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102316544:0@lo:400:kworker.0 00000004:00000024:1.0:1788970506.013648:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788970506.013660:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970506.013702:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102316416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970506.013709:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970506.013735:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102316672:0@lo:38:kworker.0 00000100:00100000:1.0:1788970506.013760:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970506.013802:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316672 00000100:00100000:1.0:1788970506.013807:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316672 00000100:00100000:1.0:1788970506.013826:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970506.013831:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102316672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788970506.013852:0:17155:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1788970506.013883:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6fb6a 00000004:00100000:1.0:1788970506.013897:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788970506.013902:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788970506.013943:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102316416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970506.013959:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970506.013966:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102316928:0@lo:400:kworker.0 00000100:00100000:1.0:1788970506.013973:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316544 00000100:00100000:1.0:1788970506.013978:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316544 00000100:00100000:3.0:1788970506.013991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970506.014012:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788970506.014020:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:3652:x1875871102316544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970506.014028:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316800 00000100:00100000:3.0:1788970506.014032:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316800 00000100:00100000:3.0:1788970506.014065:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102316928 00000100:00100000:1.0:1788970506.014067:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:3652:x1875871102316544:12345-0@lo:400:kworker.0 Request processed in 46us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970506.014068:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102316928 00000100:00100000:1.0:1788970506.014076:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788970506.014087:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970506.014096:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102316800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970506.014129:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102316800:12345-0@lo:400:kworker.0 Request processed in 36us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970506.014135:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970506.014147:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970506.014152:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102316928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970506.014187:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102316928:12345-0@lo:400:kworker.0 Request processed in 33us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970506.014203:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970506.014237:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102316544:0@lo:400:kworker.0 00010000:00080000:3.0:1788970506.014248:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d83e87c00 x1875871102316800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970506.014257:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102316800:0@lo:400:kworker.0 00010000:00080000:1.0:1788970506.014309:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d83e84780 x1875871102316928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970506.014327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102316928:0@lo:400:kworker.0 00000100:00080000:1.0:1788970506.020604:0:17155:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970506.020705:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102316672:12345-0@lo:38:kworker.0 Request processed in 6870us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970506.020717:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788970506.020814:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788970506.020823:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788970506.020828:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788970506.020830:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788970506.020853:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ad85c6cc): req@ffff8a7d836b0780 x1875871102309632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970506.020870:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102316672:0@lo:38:kworker.0 00000100:00100000:1.0:1788970506.021054:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970506.021068:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102317056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970506.021104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970506.021142:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317056 00000100:00100000:1.0:1788970506.021148:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317056 00000100:00100000:1.0:1788970506.021181:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970506.021189:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102317056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970506.021215:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970506.021252:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102317056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970506.021260:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970506.021299:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102317056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970506.021306:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970506.021334:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970506.021335:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102309632 00000100:00100000:1.0:1788970506.021341:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102309632 00000100:00100000:1.0:1788970506.021605:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970506.021611:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17191:x1875871102309632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788970506.021715:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17191:x1875871102309632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970506.021723:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970506.023651:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875871102309632:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788970506.023698:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788970506.023744:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875871102317184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788970506.023798:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970506.023840:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970506.024483:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317184 00000100:00100000:1.0:1788970506.024504:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317184 00000100:00100000:1.0:1788970506.024553:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970506.024561:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875871102317184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788970506.024723:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875871102317184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 162us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970506.024730:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970506.024833:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875871102317184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788970506.024904:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875871102317312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788970506.024934:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970506.024963:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970506.025201:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317312 00000100:00100000:2.0:1788970506.025207:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317312 00000100:00100000:2.0:1788970506.025252:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970506.025261:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17191:x1875871102317312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788970506.025320:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17191:x1875871102317312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970506.025326:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970506.025359:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875871102317312:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788970506.025528:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970506.031676:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788970506.031753:0:17191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788970506.031758:0:17191:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788970506.343172:0:18252:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970506.343582:0:18252:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970506.973601:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788970507.327203:0:18302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2ed8b200 20000000:00000080:2.0:1788970507.327219:0:18302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7ebcf3c400 uarg=0000000000000000 20000000:01000000:2.0:1788970507.327257:0:18302:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788970507.327265:0:18302:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788970507.327270:0:18302:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788970507.332827:0:18303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788970507.332990:0:18302:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788970507.342631:0:18302:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788970507.342678:0:18302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.342697:0:18302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.342705:0:18302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.342713:0:18302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.342757:0:18302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.342773:0:18302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 17 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970507.342788:0:18302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875871102317440:0@lo:104: 00000100:00100000:2.0:1788970507.342844:0:18302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970507.342902:0:18302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.342923:0:18302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 17 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970507.342932:0:18302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875871102317568:0@lo:104: 00000100:00100000:2.0:1788970507.342955:0:18302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970507.342980:0:18302:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970507.343033:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317440 00000100:00100000:3.0:1788970507.343039:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317440 00000100:00100000:3.0:1788970507.343071:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317568 00000100:00100000:3.0:1788970507.343073:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317568 00000100:00100000:3.0:1788970507.343084:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970507.343092:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+4:18302:x1875871102317440:12345-0@lo:104: 00010000:00010000:3.0:1788970507.343104:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343161:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970507.343167:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+4:18302:x1875871102317440:12345-0@lo:104: Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970507.343174:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970507.343188:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970507.343193:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+3:18302:x1875871102317568:12345-0@lo:104: 00010000:00010000:3.0:1788970507.343200:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343225:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788970507.343229:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+3:18302:x1875871102317568:12345-0@lo:104: Request processed in 37us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970507.343234:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788970507.343247:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970507.343252:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343259:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970507.343263:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343271:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970507.343279:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970507.343284:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970507.343312:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343319:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970507.343333:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343351:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3000/0xc3abfebe76c6fb16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb1d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343364:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970507.343367:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343373:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970507.343375:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343400:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970507.343406:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970507.343412:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970507.343422:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343428:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970507.343434:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343459:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae012600/0xc3abfebe76c6fa13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fa1a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343474:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970507.343476:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970507.343477:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970507.343497:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102317824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970507.343526:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970507.343547:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970507.343552:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102317696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970507.343571:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970507.343610:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317824 00000100:00100000:3.0:1788970507.343613:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317824 00010000:00010000:3.0:1788970507.343630:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 18 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970507.343647:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317696 00000100:00100000:3.0:1788970507.343650:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317696 00010000:00010000:3.0:1788970507.343659:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 19 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970507.343669:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970507.343675:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+19:3652:x1875871102317824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970507.343684:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970507.343688:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 19 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343697:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 19 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343718:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970507.343746:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+19:3652:x1875871102317824:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970507.343753:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970507.343766:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970507.343772:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+18:3652:x1875871102317696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970507.343779:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970507.343784:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 18 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343793:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 18 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343804:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343812:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343825:0:17136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343833:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343839:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343845:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343858:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970507.343862:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343868:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343877:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970507.343885:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970507.343909:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+18:3652:x1875871102317696:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970507.343916:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970507.343952:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102317696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970507.343961:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102317824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970507.344108:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970507.344197:0:18302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae013000/0xc3abfebe76c6fb1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fb16 expref: 17 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970507.344209:0:18302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875871102317440:0@lo:104: 00010000:00010000:2.0:1788970507.344219:0:18302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655200/0xc3abfebe76c6fa1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fa13 expref: 16 pid: 17145 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970507.344226:0:18302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875871102317568:0@lo:104: 00010000:00010000:2.0:1788970507.344239:0:18302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.344247:0:18302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.344253:0:18302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970507.344259:0:18302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6fb71 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970507.997942:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788970508.703480:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970508.703489:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebf423000 from 13 10000000:01000000:3.0:1788970508.703494:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970508.703543:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970508.703555:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970508.703567:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970508.703611:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102317952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970508.703681:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970508.703728:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970508.706734:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102317952 00000100:00100000:0.0:1788970508.706749:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102317952 00000100:00100000:0.0:1788970508.706796:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970508.706806:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+16:17147:x1875871102317952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970508.706824:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970508.706841:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb78 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.706869:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.706880:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.706897:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012200, rc 0) 00000100:00100000:0.0:1788970508.706970:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102317952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970508.706978:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970508.707030:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102317952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970508.707048:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.707059:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970508.707131:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.707161:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970508.707189:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970508.707203:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318080 00000100:00100000:0.0:1788970508.707206:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318080 00000100:00100000:0.0:1788970508.707230:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970508.707236:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102318080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.707356:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102318080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970508.707364:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970508.707426:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.707464:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.707502:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970508.707522:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970508.707534:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318208 00000100:00100000:0.0:1788970508.707537:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318208 00000100:00100000:0.0:1788970508.707557:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970508.707563:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102318208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.707639:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102318208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970508.707645:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970508.707683:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970508.708312:0:18365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788970508.708369:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788970508.708410:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970508.708418:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708443:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970508.708453:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970508.708455:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7e92fc7000 from 13 10000000:01000000:0.0:1788970508.708458:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970508.708481:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708489:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708498:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970508.708530:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.708563:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970508.708583:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970508.708598:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318336 00000100:00100000:0.0:1788970508.708603:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318336 00000100:00100000:0.0:1788970508.708629:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788970508.708636:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+17:17147:x1875871102318336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970508.708646:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970508.708657:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fb86 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708674:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708683:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708691:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012600, rc 0) 00000100:00100000:0.0:1788970508.708721:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102318336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970508.708727:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788970508.708760:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970508.708772:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.708780:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970508.708831:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.708855:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970508.708867:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970508.708878:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318464 00000100:00100000:0.0:1788970508.708881:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318464 00000100:00100000:0.0:1788970508.708901:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970508.708907:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102318464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.708980:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102318464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970508.708987:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970508.709017:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.709040:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.709075:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970508.709089:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970508.709099:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318592 00000100:00100000:0.0:1788970508.709103:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318592 00000100:00100000:0.0:1788970508.709122:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970508.709127:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102318592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970508.709192:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:17147:x1875871102318592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970508.709199:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970508.709244:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102318592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970508.709991:0:18366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788970508.710052:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788970508.710067:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970508.710075:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970508.710085:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970509.021828:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970510.045582:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970510.109532:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970500/real 1788970500] req@ffff8a7d83568000 x1875871102312832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970510.109564:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83568000 x1875871102312832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970510.109575:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970500/real 1788970500] req@ffff8a7d836b21c0 x1875871102312704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970510.109585:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d836b21c0 x1875871102312704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970510.109602:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970510.109629:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970510.109633:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102312832:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788970510.109640:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970510.109644:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970510.109648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102312704:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788970510.109783:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970510.109788:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970510.109803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970510.109807:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970510.109829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970510.109832:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788970510.109835:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788970510.109935:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102318848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.109998:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970510.110039:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970510.110045:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102318720:0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110069:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970510.110097:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102318976:0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110125:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970510.110139:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970510.110144:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102319104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110164:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970510.110190:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318848 00000100:00100000:0.0:1788970510.110212:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318848 00000100:00100000:0.0:1788970510.110250:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102319104 00000100:00100000:0.0:1788970510.110253:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102319104 00000100:00100000:0.0:1788970510.110268:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970510.110275:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102318848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110325:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102318848:12345-0@lo:400:kworker.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970510.110332:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970510.110347:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970510.110361:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102319104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110428:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102319104:12345-0@lo:400:kworker.0 Request processed in 58us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970510.110434:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970510.110452:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318720 00000100:00100000:0.0:1788970510.110456:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318720 00000100:00100000:0.0:1788970510.110478:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970510.110484:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:3650:x1875871102318720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110512:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+18:3650:x1875871102318720:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970510.110516:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970510.110558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102319104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110577:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102318720:0@lo:400:kworker.0 00000100:00100000:0.0:1788970510.110586:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102318848:0@lo:400:kworker.0 00000100:00080000:2.0:1788970510.110761:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788970510.110766:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788970510.110775:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7eb3da2000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970510.110796:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf515680 x1875871102319232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970510.110811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970510.110815:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788970510.110817:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970510.110820:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788970510.110823:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788970510.110827:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebf505000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970510.110838:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebf517480 x1875871102319360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970510.110936:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102319232:0@lo:8:kworker.0 00000400:00000100:0.0:1788970510.110958:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102319232 offset 0 length 520: 4 00000100:00100000:0.0:1788970510.111037:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102319360:0@lo:8:kworker.0 00000400:00000100:0.0:1788970510.111057:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102319360 offset 0 length 520: 4 00000100:00100000:3.0:1788970510.112184:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102319488:0@lo:400:kworker.0 00000100:00100000:3.0:1788970510.112241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970510.112286:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102318976 00000100:00100000:3.0:1788970510.112292:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102318976 00000100:00100000:3.0:1788970510.112336:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102319488 00000100:00100000:3.0:1788970510.112339:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102319488 00000100:00100000:3.0:1788970510.112354:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970510.112361:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102318976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970510.112429:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102318976:12345-0@lo:400:kworker.0 Request processed in 59us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970510.112436:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970510.112451:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970510.112457:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102319488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970510.112487:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102319488:12345-0@lo:400:kworker.0 Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970510.112493:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788970510.112533:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebf516d00 x1875871102319488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970510.112545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102319488:0@lo:400:kworker.0 00010000:00080000:0.0:1788970510.112635:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebf515e00 x1875871102318976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970510.112647:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102318976:0@lo:400:kworker.0 00000040:00080000:1.0:1788970510.565535:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970511.069365:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970511.132520:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970511.132540:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102319616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970511.132608:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970511.134014:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102319616 00000100:00100000:0.0:1788970511.134041:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102319616 00000100:00100000:0.0:1788970511.134093:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970511.134104:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102319616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970511.134140:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970511.134209:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102319616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970511.134217:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970511.134276:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102319616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970511.134623:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102319744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970511.134659:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970511.134759:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102319744 00000100:00100000:2.0:1788970511.134765:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102319744 00000100:00100000:2.0:1788970511.134796:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970511.134803:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102319744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970511.134823:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788970511.134959:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102319744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970511.135022:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102319744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 218us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970511.135037:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000001:00100000:3.0:1788970511.654357:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788970512.093557:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970512.160121:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970497/real 1788970497] req@ffff8a7d836b2940 x1875871102310656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970512 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970512.160156:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d836b2940 x1875871102310656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970512 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970512.160166:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970497/real 1788970497] req@ffff8a7d836b1a40 x1875871102310784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970512 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970512.160176:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d836b1a40 x1875871102310784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970512 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788970512.160194:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970512.160254:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788970512.160258:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310656:0@lo:8:kworker.0 00000100:00080000:2.0:1788970512.160264:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970512.160527:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970512.160531:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788970512.160534:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970512.160539:0:13708:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1788970512.160543:0:13708:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788970512.160553:0:13708:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7eb145c000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970512.160572:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e87840 x1875871102320128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970512.160582:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970512.160598:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970512.160600:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970512.160603:0:13708:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1788970512.160605:0:13708:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788970512.160610:0:13708:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7ebf3b5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970512.160625:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e85e00 x1875871102320256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970512.160643:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970512.160646:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970512.160649:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970512.160652:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970512.160678:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102320000:0@lo:400:kworker.0 00000100:00100000:3.0:1788970512.160747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970512.160789:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970512.160796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102320384:0@lo:400:kworker.0 00000100:00100000:3.0:1788970512.160822:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970512.160850:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102320000 00000100:00100000:3.0:1788970512.160858:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102320000 00000100:00100000:3.0:1788970512.160901:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970512.160909:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102320000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970512.160959:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102320000:12345-0@lo:400:kworker.0 Request processed in 50us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970512.160966:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970512.160987:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102320384 00000100:00100000:3.0:1788970512.160990:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102320384 00000100:00100000:3.0:1788970512.161024:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970512.161030:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102320384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970512.161061:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102320384:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970512.161067:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788970512.161105:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d83e86580 x1875871102320384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970512.161116:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102320384:0@lo:400:kworker.0 00000100:00100000:3.0:1788970512.161125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102320000:0@lo:400:kworker.0 00000100:00080000:2.0:1788970512.165105:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788970512.165116:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102310784:0@lo:8:kworker.0 00000100:00100000:2.0:1788970512.165160:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102320128:0@lo:8:kworker.0 00000400:00000100:2.0:1788970512.165231:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102320128 offset 0 length 520: 4 00000100:00100000:1.0:1788970512.165250:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102320512:0@lo:400:kworker.0 00000100:00100000:2.0:1788970512.165273:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102320256:0@lo:8:kworker.0 00000400:00000100:2.0:1788970512.165286:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102320256 offset 0 length 520: 4 00000100:00100000:1.0:1788970512.165287:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970512.165316:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788970512.165323:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102319872:0@lo:400:kworker.0 00000100:00100000:1.0:1788970512.165349:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970512.165374:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102320640:0@lo:400:kworker.0 00000100:00100000:1.0:1788970512.165429:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970512.165435:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102319872 00000100:00100000:2.0:1788970512.165443:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102319872 00000100:00100000:1.0:1788970512.165454:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102320512 00000100:00100000:1.0:1788970512.165457:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102320512 00000100:00100000:2.0:1788970512.165483:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788970512.165483:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970512.165491:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:3651:x1875871102319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970512.165491:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102320512:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788970512.165590:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970512.165594:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970512.165597:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970512.165600:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970512.165633:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102320512:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970512.165649:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788970512.165670:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102320640 00000100:00100000:1.0:1788970512.165674:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102320640 00000100:00100000:1.0:1788970512.165705:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970512.165706:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:3651:x1875871102319872:12345-0@lo:400:kworker.0 Request processed in 215us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970512.165711:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102320640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970512.165712:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788970512.165741:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102320640:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970512.165747:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970512.165777:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102319872:0@lo:400:kworker.0 00010000:00080000:1.0:1788970512.165793:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d8451a1c0 x1875871102320640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970512.165804:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102320640:0@lo:400:kworker.0 00000100:00100000:1.0:1788970512.165812:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102320512:0@lo:400:kworker.0 00000040:00080000:2.0:1788970512.925072:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970513.117749:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970513.451013:0:18649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970513.451016:0:18649:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788970513.451018:0:18649:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788970513.451143:0:18649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7d81acf000 00000020:01000004:3.0:1788970513.451157:0:18649:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788970513.451168:0:18649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788970513.451182:0:18649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a7d83393380) 00000020:00000080:3.0:1788970513.451197:0:18649:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788970513.528885:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788970513.534840:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788970513.535012:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788970513.535558:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788970513.535718:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788970513.535871:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788970513.536022:0:18649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788970513.538746:0:18649:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788970513.538959:0:18649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788970513.538971:0:18649:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788970513.538981:0:18649:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3abfebe76c6fb9b 00000020:01000004:1.0:1788970513.538987:0:18649:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788970513.539005:0:18649:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788970513.539013:0:18649:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788970513.539019:0:18649:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788970513.539024:0:18649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788970513.539034:0:18649:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a7eae153380) 00000020:00000080:1.0:1788970513.539045:0:18649:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788970513.540310:0:18649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970513.540506:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788970513.540513:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788970513.543762:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970513.543775:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788970513.544099:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788970513.544106:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788970513.550612:0:18649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970513.550794:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970513.550801:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788970513.552717:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788970513.552728:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788970513.574905:0:18649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970513.575157:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788970513.575164:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788970513.577504:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970513.577519:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788970513.583334:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788970513.583351:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788970513.586938:0:18649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970513.587153:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970513.587160:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788970513.589237:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788970513.589250:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788970513.641727:0:18649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970513.641942:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788970513.641950:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788970513.647624:0:18649:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788970513.649437:0:18649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788970513.650173:0:18649:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788970513.650202:0:18649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788970513.650208:0:18649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788970513.673727:0:18649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788970513.673767:0:18649:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788970513.673772:0:18649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788970513.673774:0:18649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970513.673775:0:18649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970513.673776:0:18649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970513.673778:0:18649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970513.673779:0:18649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970513.673780:0:18649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970513.673782:0:18649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970513.673783:0:18649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788970513.673787:0:18649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788970513.673789:0:18649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970513.673791:0:18649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970513.673792:0:18649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970513.673793:0:18649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970513.673794:0:18649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970513.673795:0:18649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970513.673796:0:18649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970513.673797:0:18649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970513.673798:0:18649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788970513.673825:0:18649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788970513.673845:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102320768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788970513.673913:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.674488:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.676809:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102320768 00000100:00100000:0.0:1788970513.676823:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102320768 00000100:00100000:0.0:1788970513.676898:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788970513.676910:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+18:18649:x1875871102320768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970513.677154:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788970513.677157:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788970513.677160:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788970513.677607:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102320768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788970513.677621:0:18649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788970513.677624:0:18649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970513.677625:0:18649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970513.677636:0:18649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970513.677638:0:18649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970513.677640:0:18649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970513.677641:0:18649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970513.677642:0:18649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970513.677644:0:18649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970513.677646:0:18649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788970513.677666:0:18649:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7d81acf000 from lustre-OST0000 10000000:01000000:1.0:1788970513.677695:0:18649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788970513.677698:0:18649:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788970513.677706:0:18649:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7d83390000 local copy 00010000:00010000:1.0:1788970513.677715:0:18649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970513.677789:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+18:18649:x1875871102320768:12345-0@lo:253:mount.lustre.0 Request processed in 620us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.677798:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788970513.677827:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102320896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970513.677862:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.677902:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970513.677913:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102320896 00000100:00100000:2.0:1788970513.677918:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102320896 00000100:00100000:2.0:1788970513.677956:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788970513.677965:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:18649:x1875871102320896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970513.678038:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+18:18649:x1875871102320896:12345-0@lo:501:mount.lustre.0 Request processed in 74us (176us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970513.678055:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788970513.678200:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102320896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788970513.678210:0:18649:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788970513.678222:0:18649:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788970513.678227:0:18649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970513.678233:0:18649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970513.678251:0:18649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7d81acf000 10000000:01000000:1.0:1788970513.678259:0:18649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788970513.678263:0:18649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788970513.678265:0:18649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970513.678268:0:18649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788970513.678270:0:18649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788970513.678288:0:18649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970513.678295:0:18649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970513.678305:0:18649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970513.678317:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970513.678342:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.678743:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.678858:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321024 00000100:00100000:0.0:1788970513.678863:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321024 00000100:00100000:0.0:1788970513.678943:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970513.678952:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+18:18649:x1875871102321024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970513.678962:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970513.678982:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6fbb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fba9 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.679007:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6fbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fba9 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.679018:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6fbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fba9 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.679026:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae012c00, rc 0) 00000100:00100000:0.0:1788970513.679069:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321024:12345-0@lo:101:mount.lustre.0 Request processed in 118us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.679076:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788970513.679105:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970513.679118:0:18649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970513.679127:0:18649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970513.682661:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788970513.683505:0:18649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970513.687025:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788970513.687085:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788970513.687101:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788970513.687117:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788970513.687145:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788970513.687161:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788970513.687186:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788970513.687192:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788970513.687295:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970513.687363:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.687453:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82465000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.687970:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321152 00000100:00100000:0.0:1788970513.687978:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321152 00000100:00100000:0.0:1788970513.688022:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970513.688032:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970513.688206:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321152:12345-0@lo:501:mount.lustre.0 Request processed in 174us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.688213:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970513.688686:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970513.688766:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970513.688808:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.688849:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.688966:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321280 00000100:00100000:0.0:1788970513.688972:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321280 00000100:00100000:0.0:1788970513.689012:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970513.689020:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970513.690556:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321280:12345-0@lo:503:mount.lustre.0 Request processed in 1528us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.690568:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788970513.690749:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970513.691901:0:18649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970513.692017:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970513.693885:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.693937:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.694888:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321408 00000100:00100000:0.0:1788970513.694911:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321408 00000100:00100000:0.0:1788970513.694965:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788970513.694975:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970513.697003:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321408:12345-0@lo:502:mount.lustre.0 Request processed in 2022us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.697016:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788970513.697178:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970513.697531:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788970513.697565:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788970513.697578:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788970513.697591:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788970513.697604:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788970513.697619:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788970513.697632:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788970513.697645:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788970513.697658:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788970513.697672:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788970513.697686:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788970513.697715:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788970513.697756:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970513.697810:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.697855:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970513.697949:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321536 00000100:00100000:1.0:1788970513.697956:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321536 00000100:00100000:1.0:1788970513.698821:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788970513.698837:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970513.699002:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321536:12345-0@lo:502:mount.lustre.0 Request processed in 170us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970513.699009:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788970513.699102:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970513.699168:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788970513.699185:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788970513.701089:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788970513.701101:0:18667:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788970513.701107:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.701110:0:18667:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788970513.701116:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970513.701133:0:18667:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a7eae1519c0) 00000020:00000080:1.0:1788970513.701158:0:18667:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788970513.701164:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788970513.701251:0:18667:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81acf000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788970513.701260:0:18667:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788970513.701267:0:18667:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3abfebe76c6fbbe 00010000:00010000:2.0:1788970513.708893:0:18667:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788970513.711623:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788970513.716695:0:18667:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788970513.718424:0:18667:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788970513.718437:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970513.718444:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970513.718446:0:18667:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788970513.718449:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788970513.718452:0:18667:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788970513.718454:0:18667:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970513.718455:0:18667:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970513.718457:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788970513.718459:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970513.718461:0:18667:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788970513.718463:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970513.718466:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970513.718467:0:18667:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970513.718470:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970513.718472:0:18667:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788970513.718474:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970513.718475:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970513.718477:0:18667:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788970513.718479:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970513.718481:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970513.718482:0:18667:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788970513.718486:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788970513.718513:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970513.718515:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970513.718516:0:18667:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788970513.718520:0:18667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788970513.718681:0:18649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788970513.718720:0:18649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788970513.718745:0:18649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.718758:0:18649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970513.718767:0:18649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81acf000 from 1 10000000:01000000:3.0:1788970513.718770:0:18649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970513.718805:0:18649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.718813:0:18649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.718824:0:18649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970513.718858:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970513.718923:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.718964:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.719311:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321664 00000100:00100000:0.0:1788970513.719320:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321664 00000100:00100000:0.0:1788970513.719378:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788970513.719428:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+19:18649:x1875871102321664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970513.719442:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970513.719454:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fbc5 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.719477:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.719487:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.719496:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eae013200, rc 0) 00000100:00100000:0.0:1788970513.719536:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102321664:12345-0@lo:101:mount.lustre.0 Request processed in 111us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.719544:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788970513.719881:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970513.719896:0:18649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.719906:0:18649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970513.724432:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788970513.724785:0:18649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970513.724999:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788970513.725025:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788970513.725044:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788970513.725049:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788970513.725120:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970513.725186:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.725224:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.725488:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321792 00000100:00100000:0.0:1788970513.725497:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321792 00000100:00100000:0.0:1788970513.725554:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788970513.725563:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102321792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970513.725684:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102321792:12345-0@lo:501:mount.lustre.0 Request processed in 122us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.725692:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788970513.726450:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970513.726498:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970513.726553:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.726711:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970513.731834:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102321920 00000100:00100000:2.0:1788970513.731923:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102321920 00000100:00100000:2.0:1788970513.732033:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970513.732052:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102321920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970513.732211:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102321920:12345-0@lo:503:mount.lustre.0 Request processed in 162us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970513.732219:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788970513.732322:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102321920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788970513.732795:0:18649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970513.734052:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970513.734121:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.736934:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.737076:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322048 00000100:00100000:0.0:1788970513.737085:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322048 00000100:00100000:0.0:1788970513.737128:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788970513.737137:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102322048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970513.737304:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102322048:12345-0@lo:502:mount.lustre.0 Request processed in 167us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.737312:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788970513.737653:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970513.738020:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788970513.738053:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788970513.738069:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788970513.738096:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788970513.738109:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788970513.738121:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788970513.738133:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788970513.738145:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788970513.738158:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788970513.738171:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788970513.738184:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788970513.738218:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970513.738268:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.738312:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d837bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.738519:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322176 00000100:00100000:0.0:1788970513.738525:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322176 00000100:00100000:0.0:1788970513.738554:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788970513.738561:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102322176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970513.738653:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102322176:12345-0@lo:502:mount.lustre.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.738660:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788970513.738955:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970513.739005:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788970513.739016:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788970513.740017:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970513.740029:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740031:0:18671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788970513.740037:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d81acf000 00000020:00000080:1.0:1788970513.740040:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970513.740047:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970513.740049:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740051:0:18671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788970513.740053:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970513.740056:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740057:0:18671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788970513.740068:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d81acf000 00000020:00000080:1.0:1788970513.740071:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970513.740131:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970513.740135:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740137:0:18671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788970513.740140:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970513.740142:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740144:0:18671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788970513.740148:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d81acf000 00000020:00000080:1.0:1788970513.740150:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970513.740167:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970513.740170:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740172:0:18671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788970513.740174:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970513.740176:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740178:0:18671:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788970513.740181:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d81acf000 00000020:00000080:1.0:1788970513.740183:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970513.740206:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970513.740210:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970513.740211:0:18671:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788970513.740214:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788970513.742206:0:18649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788970513.742247:0:18649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970513.742274:0:18649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.742295:0:18649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970513.742369:0:18649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788970513.742372:0:18649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7d81acf000 10000000:01000000:2.0:1788970513.742376:0:18649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7d81acf000 10000000:01000000:2.0:1788970513.742410:0:18649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970513.742416:0:18649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7d81acf000 from 1 10000000:01000000:2.0:1788970513.742419:0:18649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970513.742454:0:18649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.742463:0:18649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.742474:0:18649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970513.742498:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970513.742563:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970513.742616:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb5954900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970513.743964:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322304 00000100:00100000:3.0:1788970513.743976:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322304 00000100:00100000:3.0:1788970513.744081:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788970513.744091:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+20:18649:x1875871102322304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970513.744106:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970513.744121:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654400/0xc3abfebe76c6fbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fbd3 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.744148:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654400/0xc3abfebe76c6fbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fbd3 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.744160:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654400/0xc3abfebe76c6fbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fbd3 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.744180:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654400, rc 0) 00000100:00100000:3.0:1788970513.744251:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322304:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970513.744259:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788970513.744356:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970513.744373:0:18649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970513.744408:0:18649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970513.753538:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788970513.754663:0:18649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970513.755265:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788970513.755944:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788970513.755970:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788970513.755986:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788970513.756001:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788970513.756015:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788970513.756047:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788970513.756822:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788970513.757136:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788970513.757168:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788970513.757184:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788970513.757199:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788970513.757212:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788970513.757224:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788970513.757238:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788970513.757251:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788970513.757263:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788970513.757275:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788970513.757286:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788970513.757297:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788970513.757308:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788970513.757319:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788970513.757943:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788970513.757966:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788970513.757978:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788970513.757992:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788970513.758007:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788970513.758021:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788970513.758034:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788970513.758048:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788970513.758077:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788970513.758091:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788970513.758105:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788970513.758118:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788970513.758131:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788970513.758145:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788970513.758159:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788970513.758186:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788970513.758192:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788970513.759956:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970513.760023:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970513.761942:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322432 00000100:00100000:0.0:1788970513.761952:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebb8cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970513.761955:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322432 00000100:00100000:2.0:1788970513.762014:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970513.762023:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970513.762596:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322432:12345-0@lo:501:mount.lustre.0 Request processed in 161us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970513.762605:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788970513.762938:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970513.762986:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970513.766621:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970513.767689:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebb8cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970513.768373:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322560 00000100:00100000:1.0:1788970513.768402:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322560 00000100:00100000:1.0:1788970513.768505:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788970513.768521:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970513.768779:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322560:12345-0@lo:503:mount.lustre.0 Request processed in 260us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970513.768786:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788970513.772050:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788970513.772656:0:18649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970513.772756:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970513.772823:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970513.773919:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebb8cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970513.779968:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322688 00000100:00100000:1.0:1788970513.779982:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322688 00000100:00100000:1.0:1788970513.780040:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788970513.780051:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970513.780205:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322688:12345-0@lo:502:mount.lustre.0 Request processed in 156us (7382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970513.780213:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788970513.780347:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970513.780593:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788970513.780625:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788970513.780641:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788970513.780657:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788970513.780669:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788970513.780681:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788970513.780693:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788970513.780705:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788970513.780717:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788970513.780729:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788970513.780742:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788970513.780754:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788970513.780765:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788970513.780775:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788970513.780801:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788970513.780814:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788970513.780827:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788970513.781039:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788970513.781057:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788970513.781070:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788970513.781083:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788970513.781095:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788970513.781109:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788970513.781123:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788970513.781137:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788970513.781152:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788970513.781164:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788970513.781176:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788970513.781189:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788970513.781205:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788970513.781234:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788970513.781250:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788970513.781264:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788970513.781278:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788970513.781303:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788970513.781319:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788970513.781670:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788970513.781696:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788970513.781714:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788970513.781731:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788970513.781748:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788970513.781763:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788970513.781778:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788970513.781794:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788970513.781814:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788970513.781828:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788970513.781842:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788970513.781855:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788970513.781909:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970513.781986:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970513.782034:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322816 00000100:00100000:0.0:1788970513.782040:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322816 00000100:00100000:0.0:1788970513.782086:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788970513.782095:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970513.782153:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e03240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.782207:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322816:12345-0@lo:502:mount.lustre.0 Request processed in 112us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.782214:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788970513.782542:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970513.782717:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788970513.782741:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788970513.782767:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970513.782809:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.782830:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970513.782942:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102322944 00000100:00100000:0.0:1788970513.782947:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102322944 00000100:00100000:0.0:1788970513.782985:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788970513.782993:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970513.783076:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102322944:12345-0@lo:502:mount.lustre.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.783083:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788970513.783194:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102322944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970513.783232:0:18649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788970513.783240:0:18649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788970513.788626:0:18677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788970513.788646:0:18677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a7e848519c0) 00000020:00000080:3.0:1788970513.788671:0:18677:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788970513.788750:0:18677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81acf000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788970513.788755:0:18677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81acf000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788970513.788758:0:18677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81acf000 3 00010000:00080000:3.0:1788970513.788809:0:18677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf3b0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970513.792800:0:18677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788970513.793125:0:18677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788970513.793170:0:18677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970513.793182:0:18677:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3abfebe76c6fbe8 00000100:00080000:3.0:1788970513.793204:0:18677:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970513.793215:0:18677:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7ebf3b0800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970513.793258:0:18677:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d84519e00 x1875871102323072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970513.793312:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102323072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970513.793439:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.793508:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323072 00000100:00100000:3.0:1788970513.793515:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323072 00000100:00100000:3.0:1788970513.793545:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970513.793553:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102323072:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788970513.793577:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788970513.793618:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3abfebe76c6fbef 00000004:00100000:3.0:1788970513.793632:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788970513.793665:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8a7d82793000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970513.793716:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875871102323072:12345-0@lo:38:llog_process_th.0 Request processed in 162us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970513.793725:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788970513.793759:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d84519e00 x1875871102323072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970513.793768:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970513.793775:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788970513.793782:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788970513.793786:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788970513.793789:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970513.793794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102323072:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788970513.793816:0:18677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970513.794123:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970513.794133:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970513.794135:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970513.794139:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970513.794204:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102323456:0@lo:400:kworker.0 00000100:00100000:1.0:1788970513.794237:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970513.794290:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970513.794294:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970513.794297:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970513.794300:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788970513.794561:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102323584:0@lo:400:kworker.0 00000100:00100000:0.0:1788970513.794596:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970513.796003:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323584 00000100:00100000:2.0:1788970513.796015:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323584 00000100:00100000:2.0:1788970513.796067:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970513.796077:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102323584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970513.796149:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102323584:12345-0@lo:400:kworker.0 Request processed in 74us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970513.796166:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788970513.796215:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d8451b480 x1875871102323584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970513.796228:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102323584:0@lo:400:kworker.0 00000100:00100000:3.0:1788970513.799987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102323200:0@lo:400:kworker.0 00000100:00100000:3.0:1788970513.800057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.800128:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970513.800136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102323328:0@lo:400:kworker.0 00000100:00100000:3.0:1788970513.800161:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970513.800221:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323328 00000100:00100000:2.0:1788970513.800229:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323328 00000100:00100000:2.0:1788970513.800336:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970513.800346:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970513.800452:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102323328:12345-0@lo:400:kworker.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970513.800460:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788970513.800519:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d8451ad00 x1875871102323328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970513.800533:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102323328:0@lo:400:kworker.0 00000100:00100000:1.0:1788970513.800937:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323456 00000100:00100000:1.0:1788970513.800942:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323456 00000100:00100000:1.0:1788970513.801011:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323200 00000100:00100000:1.0:1788970513.801015:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323200 00000100:00100000:1.0:1788970513.801033:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970513.801041:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102323456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970513.801113:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102323456:12345-0@lo:400:kworker.0 Request processed in 72us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970513.801120:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970513.801135:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788970513.801141:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102323200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970513.801169:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102323200:12345-0@lo:400:kworker.0 Request processed in 29us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970513.801186:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970513.801418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102323200:0@lo:400:kworker.0 00000100:00100000:2.0:1788970513.801450:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102323456:0@lo:400:kworker.0 00000020:01000004:3.0:1788970513.801967:0:18677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788970513.801983:0:18677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a7e84850000) 00000020:00000080:3.0:1788970513.802004:0:18677:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788970513.802074:0:18677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81acf000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788970513.802078:0:18677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81acf000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788970513.802080:0:18677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81acf000 3 00010000:00080000:3.0:1788970513.802106:0:18677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83d76800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970513.805008:0:18677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788970513.805232:0:18677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788970513.805281:0:18677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970513.805535:0:18677:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc3abfebe76c6fbfd 00000100:00080000:0.0:1788970513.805548:0:18677:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970513.805561:0:18677:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a7d83d76800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970513.805603:0:18677:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83569680 x1875871102323712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970513.805658:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102323712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970513.805729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970513.805828:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323712 00000100:00100000:1.0:1788970513.805846:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323712 00000100:00100000:1.0:1788970513.805887:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970513.805896:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102323712:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788970513.805922:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788970513.805964:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc3abfebe76c6fc04 00000004:00100000:1.0:1788970513.805980:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788970513.806015:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbac9000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788970513.806074:0:18677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788970513.806101:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970513.806106:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970513.806108:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970513.806111:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970513.806115:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970513.806117:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970513.806120:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970513.806123:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970513.806594:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875871102323712:12345-0@lo:38:llog_process_th.0 Request processed in 696us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970513.806604:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788970513.806671:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d83569680 x1875871102323712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970513.806682:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970513.806699:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788970513.806706:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788970513.806710:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788970513.806712:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83d76800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970513.806718:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102323712:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788970513.807778:0:18677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788970513.808095:0:18649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788970513.808128:0:18649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970513.808155:0:18649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970513.808166:0:18649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788970513.808230:0:18649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788970513.808233:0:18649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970513.808235:0:18649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970513.808236:0:18649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970513.808238:0:18649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970513.808239:0:18649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970513.808241:0:18649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970513.808243:0:18649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970513.808245:0:18649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970513.808249:0:18649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788970513.808251:0:18649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970513.808253:0:18649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970513.808254:0:18649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970513.808256:0:18649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970513.808257:0:18649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970513.808259:0:18649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970513.808260:0:18649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970513.808261:0:18649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970513.808263:0:18649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970513.808297:0:18649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788970513.808525:0:18649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102323840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970513.808600:0:18649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970513.808635:0:18649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970513.809123:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323840 00000100:00100000:1.0:1788970513.809131:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323840 00000100:00100000:1.0:1788970513.809626:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970513.809637:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102323840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788970513.809665:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788970513.809677:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788970513.814084:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788970513.814105:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788970513.814126:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788970513.814130:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788970513.814153:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.814171:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.814180:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.814196:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.814233:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.814247:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 21 pid: 17143 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970513.814263:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102323968:0@lo:104: 00000100:00100000:2.0:1788970513.814476:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970513.814577:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.814587:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 21 pid: 17145 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970513.814596:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102324096:0@lo:104: 00000100:00100000:2.0:1788970513.814623:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970513.815821:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:18649:x1875871102323840:12345-0@lo:253:mount.lustre.0 Request processed in 6180us (7214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.815852:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788970513.816729:0:18649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:18649:1875871102323840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788970513.816745:0:18649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788970513.816748:0:18649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970513.816750:0:18649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970513.816751:0:18649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970513.816753:0:18649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970513.816759:0:18649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970513.816760:0:18649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970513.816762:0:18649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970513.816763:0:18649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970513.816765:0:18649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970513.816779:0:18649:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788970513.817770:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3e03900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970513.817814:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788970513.817834:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102323968 00000100:00100000:3.0:1788970513.817916:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102323968 00000100:00100000:0.0:1788970513.817978:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324096 00000100:00100000:0.0:1788970513.817982:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324096 00000100:00100000:0.0:1788970513.818004:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970513.818012:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+4:17166:x1875871102323968:12345-0@lo:104: 00010000:00010000:0.0:1788970513.818026:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818108:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970513.818114:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+4:17166:x1875871102323968:12345-0@lo:104: Request processed in 103us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.818121:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970513.818137:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970513.818143:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaecb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102324096:12345-0@lo:104: 00010000:00010000:0.0:1788970513.818150:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818183:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788970513.818188:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaecb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102324096:12345-0@lo:104: Request processed in 46us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.818194:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788970513.818233:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970513.818239:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818245:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970513.818250:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818268:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970513.818275:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970513.818281:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970513.818325:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818341:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970513.818362:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818370:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82655a00/0xc3abfebe76c6fb5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818414:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970513.818417:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818424:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970513.818426:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818433:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970513.818439:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970513.818450:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970513.818465:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818470:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970513.818477:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818482:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9600/0xc3abfebe76c6fb4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb55 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818494:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970513.818496:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970513.818498:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970513.818517:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102324224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970513.818549:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970513.818576:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970513.818582:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102324352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970513.818600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970513.818627:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324224 00000100:00100000:0.0:1788970513.818631:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324224 00010000:00010000:0.0:1788970513.818649:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 21 pid: 17143 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970513.818667:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324352 00000100:00100000:0.0:1788970513.818669:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324352 00010000:00010000:0.0:1788970513.818678:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 22 pid: 17145 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970513.818701:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970513.818706:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+22:3649:x1875871102324224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970513.818715:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970513.818720:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 22 pid: 17143 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818730:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 22 pid: 17143 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818744:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970513.818769:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+22:3649:x1875871102324224:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.818775:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970513.818788:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970513.818793:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83230050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102324352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970513.818799:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970513.818803:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 21 pid: 17145 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818812:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 21 pid: 17145 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818824:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818832:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788970513.818868:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014281431s 00010000:00010000:0.0:1788970513.818873:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818881:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818888:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818896:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818902:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970513.818906:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818913:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970513.818920:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970513.818922:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970513.818932:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970513.818956:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83230050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102324352:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970513.818963:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788970513.819021:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102324352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970513.819029:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102324224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970513.819434:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6fb63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fb5c expref: 20 pid: 17143 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970513.819446:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102323968:0@lo:104: 00010000:00010000:2.0:1788970513.819461:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fb55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fb4e expref: 19 pid: 17145 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970513.819470:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102324096:0@lo:104: 00010000:00010000:2.0:1788970513.819491:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.819499:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.819506:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970513.819512:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6fc0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788970513.826048:0:18649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788970513.829002:0:18649:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788970513.829012:0:18649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788970513.829051:0:18649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788970513.829090:0:18649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788970513.829107:0:18649:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788970513.829128:0:18649:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788970513.829799:0:18649:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970513.830000:0:18649:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970514.141249:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970514.731015:0:18730:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970514.731275:0:18730:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970515.164774:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970515.356512:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970515.356521:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebf423000 from 9 10000000:01000000:0.0:1788970515.356526:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970515.356577:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.356590:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.356601:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970515.356642:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970515.356721:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970515.356986:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970515.358270:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324480 00000100:00100000:1.0:1788970515.358292:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324480 00000100:00100000:1.0:1788970515.358352:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788970515.358362:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+19:17147:x1875871102324480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970515.358411:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970515.358430:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fc12 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970515.358454:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970515.358463:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970515.358472:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3800, rc 0) 00000100:00100000:1.0:1788970515.358546:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+20:17147:x1875871102324480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970515.358553:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788970515.360580:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970515.360607:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970515.360619:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970515.360687:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788970515.360744:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970515.360780:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970515.361168:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324608 00000100:00100000:0.0:1788970515.361175:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324608 00000100:00100000:0.0:1788970515.361229:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788970515.361238:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:17147:x1875871102324608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788970515.361267:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788970515.361292:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788970515.361295:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788970515.361410:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:17147:x1875871102324608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970515.361419:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788970515.361465:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970515.361519:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970515.361527:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.361547:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970515.361557:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970515.361559:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7e92fc7000 from 9 10000000:01000000:0.0:1788970515.361562:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970515.361586:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.361594:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.361603:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970515.361703:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970515.361732:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970515.361758:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970515.361972:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324736 00000100:00100000:1.0:1788970515.361978:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324736 00000100:00100000:1.0:1788970515.362012:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788970515.362020:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+20:17147:x1875871102324736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970515.362029:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970515.362041:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fc20 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970515.362060:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970515.362070:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970515.362077:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2600, rc 0) 00000100:00100000:1.0:1788970515.362109:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102324736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970515.362115:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788970515.363532:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970515.363556:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.363567:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970515.363642:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788970515.363696:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970515.363743:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970515.363928:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324864 00000100:00100000:1.0:1788970515.363935:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324864 00000100:00100000:1.0:1788970515.363978:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788970515.363986:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102324864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788970515.364002:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788970515.364017:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788970515.364020:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788970515.364110:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102324864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970515.364122:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970515.364424:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102324864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970515.364481:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970515.364489:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970515.364497:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970516.189195:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970516.253273:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102324992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970516.253344:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970516.253464:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102324992 00000100:00100000:1.0:1788970516.253473:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102324992 00000100:00100000:1.0:1788970516.253523:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970516.253533:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102324992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970516.253566:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788970516.253612:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102324992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970516.253620:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970516.254014:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102324992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970516.261898:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970516.261920:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102325120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970516.265125:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970516.265174:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325120 00000100:00100000:3.0:1788970516.265183:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325120 00000100:00100000:3.0:1788970516.265253:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970516.265264:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102325120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970516.265301:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788970516.265362:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102325120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970516.265370:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970516.265416:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102325120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970517.212711:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970518.241070:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970518.812653:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970518.812660:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970518.812663:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970518.812666:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970518.812688:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970518.812692:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970518.812694:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970518.812709:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970518.812775:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102325248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.812863:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.812908:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102325760:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.812934:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.812961:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788970518.812967:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102325376:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.812990:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.813008:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102325888:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.813033:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.813059:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102325504:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.813081:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.813097:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102326016:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.813118:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.813127:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970518.813132:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102325632:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.813149:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970518.813180:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325248 00000100:00100000:1.0:1788970518.813188:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325248 00000100:00100000:1.0:1788970518.813233:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788970518.813242:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102325248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.813291:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102325248:12345-0@lo:400:kworker.0 Request processed in 50us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970518.813298:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788970518.813327:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325760 00000100:00100000:1.0:1788970518.813331:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325760 00000100:00100000:1.0:1788970518.813349:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325888 00000100:00100000:1.0:1788970518.813351:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325888 00000100:00100000:0.0:1788970518.813522:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326016 00000100:00100000:0.0:1788970518.813527:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326016 00000100:00100000:0.0:1788970518.813551:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970518.813559:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102325760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970518.813595:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102325760:12345-0@lo:400:kworker.0 Request processed in 37us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970518.813601:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970518.813613:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970518.813619:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102325888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970518.813642:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102325888:12345-0@lo:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970518.813649:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970518.813661:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970518.813667:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102326016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970518.813698:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102326016:12345-0@lo:400:kworker.0 Request processed in 32us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970518.813704:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788970518.813740:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970518.813745:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970518.813783:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325504 00000100:00100000:1.0:1788970518.813788:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325504 00000100:00100000:1.0:1788970518.813854:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970518.813861:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102325504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.813892:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102325504:12345-0@lo:400:kworker.0 Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970518.813898:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970518.814554:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325376 00000100:00100000:1.0:1788970518.814561:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325376 00000100:00100000:1.0:1788970518.814586:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102325632 00000100:00100000:1.0:1788970518.814589:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102325632 00000100:00100000:1.0:1788970518.814602:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970518.814609:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102325376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.814653:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102325376:12345-0@lo:400:kworker.0 Request processed in 44us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970518.814658:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970518.814669:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970518.814675:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102325632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.814700:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102325632:12345-0@lo:400:kworker.0 Request processed in 25us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970518.814705:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970518.814751:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102325632:0@lo:400:kworker.0 00010000:00080000:1.0:1788970518.814764:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d836b0b40 x1875871102325504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970518.814774:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102325504:0@lo:400:kworker.0 00010000:00080000:1.0:1788970518.814784:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83fed680 x1875871102326016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970518.814801:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102326016:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.814840:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102325376:0@lo:400:kworker.0 00010000:00080000:1.0:1788970518.814851:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83fecb40 x1875871102325888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970518.814859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102325888:0@lo:400:kworker.0 00000100:00100000:1.0:1788970518.814868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102325248:0@lo:400:kworker.0 00010000:00080000:1.0:1788970518.814878:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83fefc00 x1875871102325760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970518.814885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102325760:0@lo:400:kworker.0 00010000:00010000:3.0:1788970519.261681:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970520.229710:0:19019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788970520.284720:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970520.799316:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788970521.035570:0:19072:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970521.035790:0:19072:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970521.309723:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970521.372739:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970521.372765:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102326144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970521.372837:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970521.372999:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326144 00000100:00100000:1.0:1788970521.373007:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326144 00000100:00100000:1.0:1788970521.373061:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970521.373071:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102326144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970521.373106:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970521.373164:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102326144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970521.373171:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788970521.373273:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102326144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970521.374014:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970521.374029:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102326272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970521.374075:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970521.374353:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326272 00000100:00100000:3.0:1788970521.374360:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326272 00000100:00100000:3.0:1788970521.374511:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970521.374520:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102326272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970521.374548:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788970521.375419:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102326272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 861us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970521.375429:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970521.379830:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102326272:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788970522.019326:0:19122:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970522.019539:0:19122:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788970522.148122:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970522.332642:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970523.357990:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970523.936979:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788970523.936982:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788970523.936986:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970523.936989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970523.936993:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970523.937013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788970523.937015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84518b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102326400:0@lo:400:kworker.0 00000100:00080000:3.0:1788970523.937017:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970523.937022:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970523.937026:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970523.937090:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102326528:0@lo:400:kworker.0 00000100:00100000:1.0:1788970523.937096:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970523.937131:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970523.937163:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102327040:0@lo:400:kworker.0 00000100:00100000:1.0:1788970523.937168:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102326784:0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.937193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970523.937271:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938190:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788970523.938295:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102326656:0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938398:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970523.938422:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102327168:0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938443:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970523.938483:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326528 00000100:00100000:3.0:1788970523.938491:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326528 00000100:00100000:3.0:1788970523.938552:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970523.938560:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102326528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938717:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102326528:12345-0@lo:400:kworker.0 Request processed in 158us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970523.938734:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788970523.938795:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327040 00000100:00100000:3.0:1788970523.938799:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327040 00000100:00100000:3.0:1788970523.938831:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326656 00000100:00100000:3.0:1788970523.938834:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326656 00000100:00100000:3.0:1788970523.938845:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327168 00000100:00100000:3.0:1788970523.938847:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327168 00000100:00100000:3.0:1788970523.938862:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970523.938869:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102327040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938901:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102327040:12345-0@lo:400:kworker.0 Request processed in 32us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970523.938907:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970523.938917:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970523.938923:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102326656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938946:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102326656:12345-0@lo:400:kworker.0 Request processed in 23us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970523.938951:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970523.938961:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970523.938967:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102327168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.938990:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102327168:12345-0@lo:400:kworker.0 Request processed in 24us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970523.938996:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788970523.939013:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970523.939016:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788970523.939039:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d84518780 x1875871102326656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970523.939052:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102326656:0@lo:400:kworker.0 00010000:00080000:3.0:1788970523.939073:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451ad00 x1875871102327168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970523.939081:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102327168:0@lo:400:kworker.0 00000100:00100000:3.0:1788970523.939091:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102326528:0@lo:400:kworker.0 00010000:00080000:3.0:1788970523.939099:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d84519e00 x1875871102327040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970523.939107:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102327040:0@lo:400:kworker.0 00000100:00100000:2.0:1788970523.939671:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326400 00000100:00100000:2.0:1788970523.939678:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326400 00000100:00100000:2.0:1788970523.939719:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788970523.939726:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102326400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970523.939770:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102326400:12345-0@lo:400:kworker.0 Request processed in 45us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970523.939776:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788970523.941548:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970523.941548:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970523.948132:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84518b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102326400:0@lo:400:kworker.0 00000100:00100000:1.0:1788970523.948726:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326784 00000100:00100000:1.0:1788970523.948734:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326784 00000100:00100000:1.0:1788970523.948788:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970523.948798:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102326784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970523.948893:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102326784:12345-0@lo:400:kworker.0 Request processed in 96us (7352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970523.948901:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970523.948934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102326784:0@lo:400:kworker.0 00000100:00100000:1.0:1788970523.949535:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102326912 00000100:00100000:1.0:1788970523.949541:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102326912 00000100:00100000:1.0:1788970523.949573:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970523.949581:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102326912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970523.949622:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102326912:12345-0@lo:400:kworker.0 Request processed in 42us (8083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970523.949628:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788970523.953448:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451b0c0 x1875871102326912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970523.953466:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102326912:0@lo:400:kworker.0 00010000:00010000:1.0:1788970524.381534:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970525.156818:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970510/real 1788970510] req@ffff8a7ebf517480 x1875871102319360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.156860:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebf517480 x1875871102319360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.156882:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970510/real 1788970510] req@ffff8a7ebf515680 x1875871102319232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.156894:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebf515680 x1875871102319232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788970525.156918:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970525.157022:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788970525.157028:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102319360:0@lo:8:kworker.0 00000100:00080000:2.0:1788970525.157034:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970525.157421:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970525.157426:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970525.157430:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970525.157433:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970525.157472:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970525.157475:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788970525.157478:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970525.157484:0:13708:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1788970525.157501:0:13708:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970525.157515:0:13708:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7eb3da2000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970525.157541:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83568000 x1875871102327808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970525.157551:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970525.157555:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970525.157556:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970525.157560:0:13708:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1788970525.157562:0:13708:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970525.157567:0:13708:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebf505000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970525.157576:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83569680 x1875871102327936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970525.157631:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102327424:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.157715:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.157757:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102328192:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.157790:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.157817:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788970525.157824:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102327296:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.157855:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.157897:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102328064:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.157920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.157950:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102327680:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.157974:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.157994:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788970525.158001:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102327552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158034:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.158052:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102328320:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158078:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970525.158103:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327424 00000100:00100000:0.0:1788970525.158112:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327424 00000100:00100000:0.0:1788970525.158161:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327680 00000100:00100000:0.0:1788970525.158164:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327680 00000100:00100000:0.0:1788970525.158180:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970525.158189:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102327424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158261:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102327424:12345-0@lo:400:kworker.0 Request processed in 72us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158268:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970525.158286:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970525.158292:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102327680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158333:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102327680:12345-0@lo:400:kworker.0 Request processed in 40us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158338:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970525.158356:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328192 00000100:00100000:0.0:1788970525.158359:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328192 00000100:00100000:0.0:1788970525.158421:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328064 00000100:00100000:0.0:1788970525.158424:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328064 00000100:00100000:0.0:1788970525.158433:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327552 00000100:00100000:0.0:1788970525.158435:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327552 00000100:00100000:0.0:1788970525.158445:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328320 00000100:00100000:0.0:1788970525.158446:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328320 00000100:00100000:0.0:1788970525.158459:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970525.158464:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102328192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158495:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102328192:12345-0@lo:400:kworker.0 Request processed in 31us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158510:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970525.158522:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970525.158528:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102328064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158555:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102328064:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158561:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970525.158570:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970525.158575:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102327552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158597:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102327552:12345-0@lo:400:kworker.0 Request processed in 23us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158603:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970525.158612:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970525.158617:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102328320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158637:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102328320:12345-0@lo:400:kworker.0 Request processed in 21us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158642:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970525.158661:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327296 00000100:00100000:0.0:1788970525.158665:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327296 00000100:00100000:0.0:1788970525.158691:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970525.158697:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:3650:x1875871102327296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158725:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:3650:x1875871102327296:12345-0@lo:400:kworker.0 Request processed in 29us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.158731:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788970525.158774:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970525.158779:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788970525.158821:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8356a580 x1875871102327552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970525.158837:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102327552:0@lo:400:kworker.0 00010000:00080000:0.0:1788970525.158848:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83ee5e00 x1875871102328320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970525.158857:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102328320:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158866:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102327680:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158903:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102327296:0@lo:400:kworker.0 00010000:00080000:0.0:1788970525.158913:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83ee7840 x1875871102328064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970525.158921:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102328064:0@lo:400:kworker.0 00000100:00100000:0.0:1788970525.158931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102327424:0@lo:400:kworker.0 00010000:00080000:0.0:1788970525.158940:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83ee4b40 x1875871102328192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970525.158948:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102328192:0@lo:400:kworker.0 00000100:00080000:2.0:1788970525.167716:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788970525.167730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf515680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102319232:0@lo:8:kworker.0 00000100:00100000:2.0:1788970525.167784:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102327808:0@lo:8:kworker.0 00000100:00100000:2.0:1788970525.167889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970525.167947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102327936:0@lo:8:kworker.0 00000100:00100000:2.0:1788970525.167975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970525.173622:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327808 00000100:00100000:3.0:1788970525.173648:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327808 00000100:00100000:3.0:1788970525.173697:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102327936 00000100:00100000:3.0:1788970525.173700:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102327936 00000100:00100000:3.0:1788970525.173719:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970525.173730:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875871102327808:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788970525.173776:0:18653:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788970525.173824:0:18653:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6fc2e 00002000:00100000:3.0:1788970525.173844:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a7eb0ea1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788970525.173849:0:18653:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788970525.173853:0:18653:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788970525.174080:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788970525.174114:0:18653:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0ea7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970525.174233:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102327808:12345-0@lo:8:kworker.0 Request processed in 503us (6344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970525.174240:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970525.174262:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970525.174267:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875871102327936:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788970525.174301:0:18653:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788970525.174538:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970525.174545:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970525.174548:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970525.174551:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1788970525.188474:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83568000 x1875871102327808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.188493:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970525.188510:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788970525.188523:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788970525.188532:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788970525.188537:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788970525.188572:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788970525.188583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102327808:0@lo:8:kworker.0 00000004:00080000:2.0:1788970525.188632:0:17891:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788970525.188761:0:17891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 544455379068ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788970525.188769:0:17891:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788970525.189054:0:17892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788970525.189082:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875871102328576:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788970525.189167:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970525.189209:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb3ebf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970525.189225:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102328448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970525.189253:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970525.189319:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328448 00000100:00100000:2.0:1788970525.189328:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328448 00000100:00100000:2.0:1788970525.189423:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970525.189434:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875871102328448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970525.189468:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970525.189520:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1875871102328448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970525.189528:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788970525.189559:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970525.189592:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf516580 x1875871102328448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.189609:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102328448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970525.189654:0:18654:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788970525.189661:0:18654:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788970525.189795:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328576 00000100:00100000:2.0:1788970525.189799:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328576 00000100:00100000:2.0:1788970525.189912:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970525.189920:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17892:x1875871102328576:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788970525.196058:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788970525.198337:0:19264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788970525.198350:0:19264:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788970525.198496:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17892:x1875871102328576:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8571us (9322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970525.198511:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788970525.198592:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf514780 x1875871102328576/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970541 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.198611:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875871102328576:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788970525.198628:0:17892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788970525.198674:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875871102328704:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788970525.198709:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970525.198732:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970525.198756:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328704 00000100:00100000:2.0:1788970525.198762:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328704 00000100:00100000:2.0:1788970525.198804:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970525.198814:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1875871102328704:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788970525.198844:0:18654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788970525.198890:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1875871102328704:12345-0@lo:5:osp-pre-0-1.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970525.198896:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788970525.198925:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf514780 x1875871102328704/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970541 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.198934:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875871102328704:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788970525.198943:0:17892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788970525.198969:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875871102328832:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788970525.198990:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970525.199003:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970525.199014:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328832 00000100:00100000:2.0:1788970525.199017:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328832 00000100:00100000:2.0:1788970525.199039:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970525.199045:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1875871102328832:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788970525.199072:0:18654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788970525.206684:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875871102327936:12345-0@lo:8:kworker.0 Request processed in 32403us (38695us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970525.206706:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788970525.207275:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970525.207284:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970525.207290:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102327936:0@lo:8:kworker.0 00000001:00080000:0.0:1788970525.271238:0:18650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788970525.271262:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788970525.271543:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1875871102328832:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72492us (72545us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788970525.271561:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788970525.271923:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf514780 x1875871102328832/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970541 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970525.271938:0:17892:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788970525.271946:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875871102328832:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788970525.271966:0:17892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788970525.272032:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1875871102328960:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788970525.272095:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970525.272128:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970525.273921:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102328960 00000100:00100000:0.0:1788970525.273941:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102328960 00000100:00100000:0.0:1788970525.274065:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970525.274079:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1875871102328960:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788970525.274237:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1875871102328960:12345-0@lo:900:osp-pre-0-1.0 Request processed in 160us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970525.274252:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788970525.274901:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebf514780 x1875871102328960/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970541 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970525.274919:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1875871102328960:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788970525.411411:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970526.428687:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970526.492979:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102329216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970526.493094:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970526.493159:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102329088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970526.493185:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970526.493297:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329216 00000100:00100000:0.0:1788970526.493317:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329216 00000100:00100000:0.0:1788970526.493366:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329088 00000100:00100000:0.0:1788970526.493369:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329088 00000100:00100000:0.0:1788970526.493411:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970526.493422:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102329216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970526.493459:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970526.493506:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102329216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970526.493513:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970526.493532:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970526.493537:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102329088:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970526.493546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf514b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102329216:0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970526.493552:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788970526.493591:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102329088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970526.493597:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970526.493612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102329088:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788970527.454208:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970528.476489:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970528.635765:0:19468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970528.635769:0:19468:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788970528.635771:0:19468:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788970528.635882:0:19468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7eb0ea2800 00000020:01000004:3.0:1788970528.635899:0:19468:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788970528.635914:0:19468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788970528.635928:0:19468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a7e84854d40) 00000020:00000080:3.0:1788970528.635947:0:19468:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788970528.676355:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788970528.677400:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788970528.677637:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788970528.677843:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788970528.678203:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788970528.678520:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788970528.678724:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788970528.681674:0:19468:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788970528.681897:0:19468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788970528.681911:0:19468:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788970528.681923:0:19468:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3abfebe76c6fc3c 00000020:01000004:2.0:1788970528.681931:0:19468:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788970528.681952:0:19468:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788970528.681956:0:19468:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788970528.681961:0:19468:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788970528.682001:0:19468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788970528.682007:0:19468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788970528.692935:0:19468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970528.692978:0:19468:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788970528.692983:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970528.692985:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970528.692986:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970528.692987:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970528.692989:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970528.692990:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970528.692997:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970528.692999:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970528.693001:0:19468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970528.693004:0:19468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788970528.693006:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970528.693008:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970528.693009:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970528.693010:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970528.693011:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970528.693012:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970528.693013:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970528.693014:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970528.693015:0:19468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970528.693043:0:19468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788970528.693064:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970528.693144:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.693263:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.693483:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329344 00000100:00100000:2.0:1788970528.693492:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329344 00000100:00100000:2.0:1788970528.693538:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788970528.693547:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:19468:x1875871102329344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970528.693574:0:17143:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788970528.693577:0:17143:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788970528.693581:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788970528.693922:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:19468:x1875871102329344:12345-0@lo:253:mount.lustre.0 Request processed in 375us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.693930:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788970528.694006:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788970528.694016:0:19468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788970528.694019:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788970528.694020:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970528.694022:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970528.694023:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970528.694024:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970528.694025:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970528.694026:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970528.694027:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970528.694028:0:19468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788970528.694046:0:19468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7eb0ea2800 from lustre-OST0001 10000000:01000000:3.0:1788970528.694071:0:19468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788970528.694074:0:19468:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788970528.694082:0:19468:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7d83390000 local copy 00010000:00010000:3.0:1788970528.694091:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970528.694166:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970528.694347:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.694464:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970528.694541:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329472 00000100:00100000:0.0:1788970528.694548:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329472 00000100:00100000:0.0:1788970528.694631:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788970528.694640:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:19468:x1875871102329472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970528.694719:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:19468:x1875871102329472:12345-0@lo:501:mount.lustre.0 Request processed in 81us (372us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788970528.694727:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788970528.694785:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329472:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788970528.694799:0:19468:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788970528.694817:0:19468:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788970528.694823:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.694833:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970528.694858:0:19468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7eb0ea2800 10000000:01000000:3.0:1788970528.694863:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788970528.694868:0:19468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788970528.694871:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970528.694875:0:19468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788970528.694878:0:19468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788970528.694899:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.694907:0:19468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.694916:0:19468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970528.694930:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970528.694958:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.695057:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970528.695145:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329600 00000100:00100000:1.0:1788970528.695150:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329600 00000100:00100000:1.0:1788970528.695176:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788970528.695194:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:19468:x1875871102329600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970528.695203:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970528.695216:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2400/0xc3abfebe76c6fc4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fc43 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970528.695236:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2400/0xc3abfebe76c6fc4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc43 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970528.695246:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df2400/0xc3abfebe76c6fc4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc43 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970528.695253:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2400, rc 0) 00000100:00100000:1.0:1788970528.695311:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329600:12345-0@lo:101:mount.lustre.0 Request processed in 129us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970528.695317:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788970528.695520:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970528.695534:0:19468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.695543:0:19468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970528.696586:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788970528.697135:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970528.700081:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788970528.700144:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788970528.700164:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788970528.700196:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788970528.700218:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788970528.700234:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788970528.700262:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788970528.701693:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788970528.701825:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970528.701896:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.702043:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970528.702084:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329728 00000100:00100000:0.0:1788970528.702091:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329728 00000100:00100000:0.0:1788970528.702200:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788970528.702210:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970528.702435:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329728:12345-0@lo:501:mount.lustre.0 Request processed in 226us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970528.702443:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788970528.702663:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970528.702701:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970528.702746:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.702775:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e880a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.702823:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329856 00000100:00100000:2.0:1788970528.702828:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329856 00000100:00100000:2.0:1788970528.702864:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970528.702873:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970528.703624:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329856:12345-0@lo:503:mount.lustre.0 Request processed in 750us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.703633:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788970528.703762:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329856:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970528.704411:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970528.704492:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970528.704554:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.704597:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.704660:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102329984 00000100:00100000:2.0:1788970528.704667:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102329984 00000100:00100000:2.0:1788970528.704751:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788970528.704760:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970528.705239:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102329984:12345-0@lo:502:mount.lustre.0 Request processed in 479us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.705247:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788970528.705495:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102329984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970528.705681:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788970528.705711:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788970528.705731:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788970528.705747:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788970528.705764:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788970528.705780:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788970528.705795:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788970528.705810:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788970528.705826:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788970528.705855:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970528.705895:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.705919:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970528.705977:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330112 00000100:00100000:0.0:1788970528.705983:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330112 00000100:00100000:0.0:1788970528.706024:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788970528.706032:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102330112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970528.706125:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102330112:12345-0@lo:502:mount.lustre.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970528.706132:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788970528.706373:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970528.706447:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788970528.706457:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788970528.707100:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788970528.707109:0:19472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788970528.707115:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.707117:0:19472:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788970528.707122:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970528.707139:0:19472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a7e84853380) 00000020:00000080:3.0:1788970528.707162:0:19472:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788970528.707168:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970528.707494:0:19472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7eb0ea2800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788970528.707504:0:19472:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970528.707511:0:19472:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3abfebe76c6fc58 00010000:00010000:3.0:1788970528.712626:0:19472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788970528.713467:0:19472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788970528.715041:0:19472:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788970528.716414:0:19472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788970528.716425:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.716431:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.716433:0:19472:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788970528.716436:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970528.716440:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.716441:0:19472:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788970528.716444:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788970528.716446:0:19472:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788970528.716448:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.716450:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.716451:0:19472:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788970528.716454:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970528.716456:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.716457:0:19472:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788970528.716461:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788970528.716484:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.716487:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.716489:0:19472:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788970528.716492:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788970528.716714:0:19468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788970528.716743:0:19468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788970528.716769:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.716782:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970528.716791:0:19468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0ea2800 from 1 10000000:01000000:0.0:1788970528.716793:0:19468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970528.716827:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.716836:0:19468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.716847:0:19468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970528.716878:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970528.716938:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970528.716981:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e87c00b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970528.717039:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330240 00000100:00100000:3.0:1788970528.717046:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330240 00000100:00100000:3.0:1788970528.717090:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788970528.717098:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:19468:x1875871102330240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970528.717109:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970528.717120:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fc5f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.717141:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.717159:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.717167:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655600, rc 0) 00000100:00100000:3.0:1788970528.717203:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330240:12345-0@lo:101:mount.lustre.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.717210:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788970528.717312:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970528.717326:0:19468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.717335:0:19468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970528.718874:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788970528.719164:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970528.720598:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788970528.720645:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788970528.720669:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788970528.720675:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788970528.720782:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970528.720852:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970528.720941:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e87c00600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970528.727483:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330368 00000100:00100000:3.0:1788970528.727497:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330368 00000100:00100000:3.0:1788970528.727605:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788970528.727615:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970528.727787:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330368:12345-0@lo:501:mount.lustre.0 Request processed in 173us (6933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.727795:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788970528.727897:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970528.727950:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970528.728007:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970528.730774:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.730849:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330496 00000100:00100000:2.0:1788970528.730858:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330496 00000100:00100000:2.0:1788970528.730901:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788970528.730911:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970528.731061:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330496:12345-0@lo:503:mount.lustre.0 Request processed in 151us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.731069:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788970528.731161:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330496:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788970528.731642:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970528.731731:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970528.731779:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970528.731801:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.732017:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330624 00000100:00100000:2.0:1788970528.732023:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330624 00000100:00100000:2.0:1788970528.732047:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788970528.732061:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970528.732142:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330624:12345-0@lo:502:mount.lustre.0 Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.732149:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788970528.732304:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970528.732530:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788970528.732558:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788970528.732573:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788970528.732585:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788970528.732598:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788970528.732611:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788970528.732626:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788970528.732640:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788970528.732654:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788970528.732666:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788970528.732679:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788970528.732704:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970528.732743:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970528.732757:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.732898:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330752 00000100:00100000:2.0:1788970528.732904:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330752 00000100:00100000:2.0:1788970528.732925:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788970528.732932:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970528.733015:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330752:12345-0@lo:502:mount.lustre.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.733022:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788970528.733353:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970528.733429:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788970528.733439:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788970528.734063:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970528.734074:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.734076:0:19476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788970528.734083:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7eb0ea2800 00000020:00000080:3.0:1788970528.734085:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970528.734094:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.734096:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.734097:0:19476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788970528.734100:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970528.734103:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.734104:0:19476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788970528.734107:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7eb0ea2800 00000020:00000080:3.0:1788970528.734109:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970528.734171:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.737515:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.737521:0:19476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788970528.737533:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970528.737559:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.737561:0:19476:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788970528.737567:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7eb0ea2800 00000020:00000080:3.0:1788970528.737570:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970528.737636:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.739572:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.739580:0:19476:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788970528.739591:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970528.739597:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.739598:0:19476:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788970528.739603:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7eb0ea2800 00000020:00000080:3.0:1788970528.739605:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970528.739696:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970528.739700:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970528.739702:0:19476:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788970528.739705:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788970528.741796:0:19468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788970528.741843:0:19468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970528.741873:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.741887:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970528.741952:0:19468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788970528.741956:0:19468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7eb0ea2800 10000000:01000000:3.0:1788970528.741959:0:19468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7eb0ea2800 10000000:01000000:3.0:1788970528.741964:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970528.741971:0:19468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7eb0ea2800 from 1 10000000:01000000:3.0:1788970528.741981:0:19468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970528.742019:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.742029:0:19468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.742041:0:19468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970528.742067:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970528.742134:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.742170:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970528.743492:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102330880 00000100:00100000:3.0:1788970528.743504:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102330880 00000100:00100000:3.0:1788970528.743596:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788970528.743608:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+23:19468:x1875871102330880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970528.743625:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970528.743641:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6fc74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fc6d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.743668:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6fc74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc6d expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.743680:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6fc74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc6d expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.743688:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655000, rc 0) 00000100:00100000:3.0:1788970528.743745:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102330880:12345-0@lo:101:mount.lustre.0 Request processed in 140us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.743763:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788970528.751642:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102330880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970528.751671:0:19468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.751683:0:19468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970528.752855:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788970528.753115:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970528.755540:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788970528.755600:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788970528.755619:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788970528.755636:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788970528.755652:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788970528.755673:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788970528.755689:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788970528.755704:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788970528.755720:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788970528.755737:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788970528.755753:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788970528.755770:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788970528.755786:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788970528.755803:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788970528.755817:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788970528.755832:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788970528.755865:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788970528.755883:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788970528.755899:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788970528.755915:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788970528.755942:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788970528.755958:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788970528.755970:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788970528.755983:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788970528.755996:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788970528.756010:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788970528.756024:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788970528.756037:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788970528.756050:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788970528.756063:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788970528.756075:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788970528.756086:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788970528.756111:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788970528.756126:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788970528.756140:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788970528.756155:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788970528.756171:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788970528.758422:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788970528.758478:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788970528.758494:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788970528.758507:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788970528.758519:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788970528.758532:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788970528.758547:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788970528.758560:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788970528.758573:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788970528.758597:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788970528.758603:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788970528.758709:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970528.758768:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.758812:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970528.760324:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331008 00000100:00100000:1.0:1788970528.760335:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331008 00000100:00100000:1.0:1788970528.760406:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788970528.760416:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970528.760563:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331008:12345-0@lo:501:mount.lustre.0 Request processed in 149us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970528.760571:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788970528.760766:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970528.760812:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970528.760853:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.760887:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970528.762412:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331136 00000100:00100000:1.0:1788970528.762424:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331136 00000100:00100000:1.0:1788970528.762470:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788970528.762479:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970528.762615:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331136:12345-0@lo:503:mount.lustre.0 Request processed in 136us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970528.762623:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788970528.763459:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970528.763867:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970528.763951:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970528.764437:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.764470:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331264 00000100:00100000:3.0:1788970528.764476:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331264 00000100:00100000:3.0:1788970528.764516:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788970528.764525:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970528.764613:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331264:12345-0@lo:502:mount.lustre.0 Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.764619:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788970528.764673:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970528.764689:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970528.764861:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788970528.764890:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788970528.764907:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788970528.764922:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788970528.764937:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788970528.764952:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788970528.764965:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788970528.764977:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788970528.764990:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788970528.765004:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788970528.765017:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788970528.765042:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788970528.765054:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788970528.765066:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788970528.765077:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788970528.765101:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788970528.765115:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788970528.765125:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788970528.765137:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788970528.765149:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788970528.765161:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788970528.765174:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788970528.770215:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788970528.770264:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788970528.770282:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788970528.770311:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788970528.770325:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788970528.770339:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788970528.770354:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788970528.770368:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788970528.770445:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788970528.770479:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788970528.770497:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788970528.770510:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788970528.770523:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788970528.770538:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788970528.770553:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788970528.770568:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788970528.770583:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788970528.770598:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788970528.770612:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788970528.770627:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788970528.770642:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788970528.770658:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788970528.770686:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788970528.770700:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788970528.770711:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788970528.770737:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788970528.770789:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970528.770860:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.770900:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecf66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970528.774662:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331392 00000100:00100000:1.0:1788970528.774678:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331392 00000100:00100000:1.0:1788970528.774735:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970528.774746:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970528.774927:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331392:12345-0@lo:502:mount.lustre.0 Request processed in 183us (4066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970528.774935:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788970528.775440:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970528.775672:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788970528.775701:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788970528.775740:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970528.775794:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970528.775832:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970528.776445:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331520 00000100:00100000:1.0:1788970528.776454:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331520 00000100:00100000:1.0:1788970528.776507:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788970528.776514:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970528.776629:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102331520:12345-0@lo:502:mount.lustre.0 Request processed in 114us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970528.776637:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788970528.776740:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102331520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970528.776799:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788970528.776811:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788970528.777678:0:19482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788970528.777694:0:19482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a7eae090000) 00000020:00000080:0.0:1788970528.777717:0:19482:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788970528.777788:0:19482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7eb0ea2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788970528.777799:0:19482:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eb0ea2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788970528.777802:0:19482:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0ea2800 3 00010000:00080000:0.0:1788970528.777831:0:19482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7eb0c22800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970528.786707:0:19482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788970528.786908:0:19482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788970528.786958:0:19482:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970528.786976:0:19482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3abfebe76c6fc82 00000100:00080000:3.0:1788970528.786986:0:19482:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970528.786997:0:19482:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7eb0c22800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970528.787036:0:19482:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83e86580 x1875871102331648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970528.787117:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102331648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970528.787187:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970528.790340:0:19482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970528.790424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970528.790429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970528.790432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970528.790435:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970528.790474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970528.790477:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970528.790481:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970528.790488:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:3.0:1788970528.790494:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788970528.790504:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebf505000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970528.790524:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8451a940 x1875871102332288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970528.790627:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331648 00000100:00100000:0.0:1788970528.790635:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331648 00000100:00100000:0.0:1788970528.790674:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970528.790681:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102331648:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788970528.790705:0:17150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1788970528.790739:0:17150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3abfebe76c6fc89 00000004:00100000:0.0:1788970528.790753:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970528.790784:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c25000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970528.790904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102332288:0@lo:8:kworker.0 00000100:00100000:1.0:1788970528.790944:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.791104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102331776:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791135:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.791161:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970528.791168:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102331904:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.791220:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102332032:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791242:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.791260:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970528.791265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102332160:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791299:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.791328:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332288 00000100:00100000:2.0:1788970528.791333:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332288 00000100:00100000:2.0:1788970528.791352:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332160 00000100:00100000:2.0:1788970528.791355:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332160 00000100:00100000:2.0:1788970528.791419:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970528.791427:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102332160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791475:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102332160:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.791483:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970528.791498:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970528.791502:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875871102332288:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788970528.791539:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875871102332288:12345-0@lo:8:kworker.0 Request processed in 34us (594us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788970528.791545:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970528.791567:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331776 00000100:00100000:2.0:1788970528.791571:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331776 00000100:00100000:2.0:1788970528.791594:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332032 00000100:00100000:2.0:1788970528.791597:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332032 00000100:00100000:2.0:1788970528.791610:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970528.791616:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102331776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791652:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102331776:12345-0@lo:400:kworker.0 Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.791658:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970528.791669:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970528.791675:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102332032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791703:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102332032:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.791709:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970528.791728:0:17151:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788970528.791736:0:17151:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1788970528.791757:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788970528.791785:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451b0c0 x1875871102332160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970528.791811:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102332160:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791825:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102332032:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.791856:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102331776:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.793681:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102331904 00000100:00100000:2.0:1788970528.793691:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102331904 00000100:00100000:2.0:1788970528.793734:0:17151:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788970528.793747:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970528.793756:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102331904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.793834:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102331904:12345-0@lo:400:kworker.0 Request processed in 79us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.793841:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788970528.793883:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83e861c0 x1875871102331904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970528.793898:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102331904:0@lo:400:kworker.0 00000100:00100000:3.0:1788970528.794180:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970528.794194:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102332672:0@lo:400:kworker.0 00000100:00100000:3.0:1788970528.794233:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970528.794339:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875871102331648:12345-0@lo:38:llog_process_th.0 Request processed in 3655us (7150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970528.794347:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970528.794363:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332672 00000100:00100000:0.0:1788970528.794368:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332672 00000100:00100000:0.0:1788970528.794429:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788970528.794436:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102332672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970528.794475:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102332672:12345-0@lo:400:kworker.0 Request processed in 39us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970528.794482:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788970528.794511:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d84519a40 x1875871102332672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970528.794520:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102332672:0@lo:400:kworker.0 00000100:00080000:3.0:1788970528.794591:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788970528.794662:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83e86580 x1875871102331648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970528.794671:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970528.794679:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788970528.794685:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788970528.794690:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788970528.794693:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788970528.794699:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102331648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970528.794743:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970528.794747:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970528.794751:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788970528.794754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102332288:0@lo:8:kworker.0 00000100:00100000:2.0:1788970528.794837:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84518b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102332416:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.794866:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.794924:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970528.794932:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102332544:0@lo:400:kworker.0 00000100:00100000:2.0:1788970528.794956:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970528.795223:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332416 00000100:00100000:0.0:1788970528.795228:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332416 00000100:00100000:0.0:1788970528.795251:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332544 00000100:00100000:0.0:1788970528.795264:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332544 00000100:00100000:0.0:1788970528.795305:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970528.795312:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102332416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970528.795353:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102332416:12345-0@lo:400:kworker.0 Request processed in 41us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970528.795359:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970528.795373:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970528.795409:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102332544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970528.795436:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102332544:12345-0@lo:400:kworker.0 Request processed in 58us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970528.795442:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788970528.795494:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788970528.795564:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d84519e00 x1875871102332544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970528.795574:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102332544:0@lo:400:kworker.0 00010000:00080000:2.0:1788970528.795584:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d84518b40 x1875871102332416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970528.795600:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84518b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102332416:0@lo:400:kworker.0 00000020:01000004:3.0:1788970528.795803:0:19482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788970528.795828:0:19482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a7d83068000) 00000020:00000080:3.0:1788970528.795852:0:19482:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788970528.795929:0:19482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7eb0ea2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970528.795933:0:19482:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eb0ea2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970528.795936:0:19482:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0ea2800 3 00010000:00080000:3.0:1788970528.795967:0:19482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83689800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970528.797660:0:19482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788970528.797885:0:19482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788970528.797927:0:19482:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970528.797941:0:19482:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc3abfebe76c6fc97 00000100:00080000:3.0:1788970528.797951:0:19482:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970528.797962:0:19482:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a7d83689800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970528.798005:0:19482:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d84518780 x1875871102332800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970528.798068:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102332800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970528.798128:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970528.798189:0:19482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788970528.798211:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970528.798215:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970528.798218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970528.798221:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970528.801396:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332800 00000100:00100000:1.0:1788970528.801410:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332800 00000100:00100000:1.0:1788970528.801462:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970528.801471:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102332800:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788970528.801501:0:17150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1788970528.801539:0:17150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc3abfebe76c6fc9e 00000004:00100000:1.0:1788970528.801555:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788970528.801589:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbac9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970528.801681:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875871102332800:12345-0@lo:38:llog_process_th.0 Request processed in 209us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970528.801689:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788970528.801901:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d84518780 x1875871102332800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970528.801914:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970528.801923:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788970528.801929:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788970528.801935:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788970528.801937:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83689800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970528.801943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102332800:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788970528.805600:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788970528.806115:0:19468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788970528.806148:0:19468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970528.806173:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970528.806185:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788970528.806233:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788970528.806235:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788970528.806236:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970528.806238:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970528.806239:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970528.806240:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970528.806241:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970528.806243:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970528.806244:0:19468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970528.806248:0:19468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788970528.806251:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970528.806252:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788970528.806253:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970528.806254:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970528.806255:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970528.806257:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970528.806258:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970528.806259:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970528.806260:0:19468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970528.806298:0:19468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788970528.806318:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102332928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788970528.806502:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970528.806565:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970528.806665:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102332928 00000100:00100000:2.0:1788970528.806673:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102332928 00000100:00100000:2.0:1788970528.806750:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788970528.806760:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102332928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970528.806799:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788970528.806812:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788970528.809210:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970528.809230:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788970528.809606:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970528.809611:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788970528.809633:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.809651:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.809659:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.809666:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.809706:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.809720:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970528.809746:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102333056:0@lo:104: 00000100:00100000:0.0:1788970528.809806:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970528.809848:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.809857:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 24 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970528.809866:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102333184:0@lo:104: 00000100:00100000:0.0:1788970528.809902:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970528.809928:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e87c00d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970528.810340:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333056 00000100:00100000:3.0:1788970528.810349:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333056 00000100:00100000:3.0:1788970528.810416:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333184 00000100:00100000:3.0:1788970528.810419:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333184 00000100:00100000:3.0:1788970528.810434:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970528.810443:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+4:17166:x1875871102333056:12345-0@lo:104: 00000100:00100000:2.0:1788970528.810447:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:19468:x1875871102332928:12345-0@lo:253:mount.lustre.0 Request processed in 3689us (3945us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970528.810454:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970528.810455:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1788970528.810526:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970528.810532:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+4:17166:x1875871102333056:12345-0@lo:104: Request processed in 90us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.810539:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970528.810553:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970528.810558:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102333184:12345-0@lo:104: 00010000:00010000:3.0:1788970528.810566:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810605:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788970528.810611:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:17166:x1875871102333184:12345-0@lo:104: Request processed in 53us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.810616:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788970528.810634:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970528.810640:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.810642:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970528.810648:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970528.810652:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810662:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970528.810670:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970528.810676:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788970528.810710:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810717:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970528.810744:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810752:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013a00/0xc3abfebe76c6fc20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810765:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970528.810766:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970528.810768:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970528.810779:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102333312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970528.810787:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102333056:0@lo:104: 00000100:00100000:0.0:1788970528.810796:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875871102333184:0@lo:104: 00000100:00100000:3.0:1788970528.810807:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970528.810818:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970528.810846:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333312 00000100:00100000:3.0:1788970528.810850:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333312 00010000:00010000:3.0:1788970528.810867:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970528.810893:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970528.810900:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102333312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970528.810910:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970528.810915:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810926:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810940:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6fc27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fc20 expref: 24 pid: 17145 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970528.810959:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970528.810990:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+23:3650:x1875871102333312:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970528.810996:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970528.811028:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102333312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970528.811161:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c12dceb-6b52-416d-b090-7691eb149d35:19468:1875871102332928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788970528.811173:0:19468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788970528.811176:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970528.811178:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788970528.811179:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970528.811180:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970528.811182:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970528.811183:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970528.811184:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970528.811186:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970528.811188:0:19468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970528.811198:0:19468:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788970528.811418:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970528.811421:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970528.811423:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970528.811607:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811616:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970528.811621:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811628:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970528.811635:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970528.811640:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788970528.811664:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811678:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970528.811706:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811714:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae012000/0xc3abfebe76c6fc12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc19 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811729:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970528.811730:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970528.811732:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970528.811739:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970528.811749:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102333440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970528.811785:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970528.811824:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333440 00000100:00100000:2.0:1788970528.811829:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333440 00010000:00010000:2.0:1788970528.811845:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 23 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970528.811865:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970528.811872:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+23:3652:x1875871102333440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970528.811882:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970528.811886:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 23 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811896:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 23 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811907:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fc19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fc12 expref: 23 pid: 17144 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811924:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.811932:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970528.812464:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014281431s 00010000:00010000:2.0:1788970528.812639:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812648:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812655:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812662:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812667:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970528.812671:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812679:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.812824:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970528.812832:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812862:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812870:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012400/0xc3abfebe76c6fca5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970528.812897:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970528.813029:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+22:3652:x1875871102333440:12345-0@lo:103:ldlm_bl.0 Request processed in 1155us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970528.813037:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970528.813047:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102333440:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788970528.819765:0:19468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788970528.822049:0:19468:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788970528.822059:0:19468:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788970528.822100:0:19468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788970528.822143:0:19468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788970528.822240:0:19468:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788970528.822269:0:19468:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788970528.823169:0:19468:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970528.823472:0:19468:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788970529.500604:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788970529.717896:0:19537:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970529.718122:0:19537:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788970529.954215:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788970529.954222:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7ebf423000 from 10 10000000:01000000:3.0:1788970529.954227:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970529.954283:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970529.954296:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970529.954307:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970529.954333:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970529.954413:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970529.954446:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970529.954465:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333568 00000100:00100000:3.0:1788970529.954472:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333568 00000100:00100000:3.0:1788970529.954525:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788970529.954533:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102333568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970529.954552:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970529.954564:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6fcb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fcac expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970529.954586:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6fcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fcac expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970529.954596:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6fcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fcac expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970529.954604:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655800, rc 0) 00000100:00100000:3.0:1788970529.954637:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102333568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970529.954643:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788970529.954688:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970529.954700:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970529.954708:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970529.954748:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788970529.954775:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970529.954790:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82449000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970529.954801:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333696 00000100:00100000:3.0:1788970529.954804:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333696 00000100:00100000:3.0:1788970529.954824:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970529.954830:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102333696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788970529.954849:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970529.954864:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970529.954866:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788970529.954941:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102333696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970529.954948:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788970529.955404:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788970529.955465:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970529.955471:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955479:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970529.955488:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788970529.955490:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7e92fc7000 from 10 10000000:01000000:2.0:1788970529.955492:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970529.955511:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955518:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955536:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970529.955548:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970529.955578:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970529.955602:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970529.955614:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333824 00000100:00100000:2.0:1788970529.955617:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333824 00000100:00100000:2.0:1788970529.955641:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788970529.955647:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102333824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970529.955654:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970529.955663:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fcc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fcba expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955678:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fcba expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955687:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fcba expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955694:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8c00, rc 0) 00000100:00100000:2.0:1788970529.955719:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102333824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970529.955725:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788970529.955752:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970529.955761:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.955774:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970529.955806:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788970529.955831:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970529.955843:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970529.955852:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102333952 00000100:00100000:2.0:1788970529.955855:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102333952 00000100:00100000:2.0:1788970529.955872:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970529.955877:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102333952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788970529.955887:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970529.956038:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970529.956042:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788970529.956099:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102333952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 220us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970529.956106:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970529.956132:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102333952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788970529.956416:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970529.956422:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970529.956431:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970530.014865:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788970530.525591:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970530.589730:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970530.589755:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102334080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970530.589835:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970530.589929:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334080 00000100:00100000:2.0:1788970530.589937:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334080 00000100:00100000:2.0:1788970530.590003:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970530.590011:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102334080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970530.590038:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970530.590083:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102334080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970530.590090:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788970530.590147:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970530.590191:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ddde00 x1875871102334080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970530.590210:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102334080:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788970531.550670:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970531.612597:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102334208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970531.612684:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970531.612710:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102334336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970531.612741:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970531.612832:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334208 00000100:00100000:3.0:1788970531.612839:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334336 00000100:00100000:3.0:1788970531.612842:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334336 00000100:00100000:2.0:1788970531.612842:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334208 00000100:00100000:3.0:1788970531.612900:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970531.612905:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970531.612908:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102334336:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970531.612911:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102334208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970531.612945:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:2.0:1788970531.612945:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788970531.612993:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102334336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970531.612998:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102334208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970531.613001:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788970531.613004:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788970531.613053:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102334208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970531.613130:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102334336:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788970532.382048:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970532.580508:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970532.901458:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970512/real 1788970512] req@ffff8a7d83e87840 x1875871102320128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970532.901492:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83e87840 x1875871102320128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970532.901501:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970512/real 1788970512] req@ffff8a7d83e85e00 x1875871102320256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970532.901512:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d83e85e00 x1875871102320256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788970532.901530:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970532.901546:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788970532.901550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102320128:0@lo:8:kworker.0 00000100:00080000:0.0:1788970532.901555:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970532.901560:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788970532.901562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102320256:0@lo:8:kworker.0 00000100:00080000:0.0:1788970532.901644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970532.901648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788970532.901650:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970532.901655:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1788970532.901661:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788970532.901670:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7eb145c000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970532.901689:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee4f00 x1875871102334720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970532.901703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970532.901716:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970532.901718:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970532.901721:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1788970532.901724:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788970532.901729:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7ebf3b5000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970532.901742:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee43c0 x1875871102334848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970532.901776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970532.901779:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970532.901781:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970532.901786:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebf505000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970532.901796:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee5e00 x1875871102335360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970532.901843:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102334464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.901904:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.901940:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.901965:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.901985:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102335872:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902013:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902032:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788970532.902037:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102334592:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902059:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902076:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102335488:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902098:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902124:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102336000:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902149:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902176:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102334720:0@lo:8:kworker.0 00000100:00100000:0.0:1788970532.902196:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902213:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102334848:0@lo:8:kworker.0 00000100:00100000:0.0:1788970532.902234:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102335360:0@lo:8:kworker.0 00000100:00100000:0.0:1788970532.902283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102334976:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902501:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102335616:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902541:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970532.902554:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788970532.902559:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102335104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.902579:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970532.902717:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335872 00000100:00100000:1.0:1788970532.902726:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335872 00000100:00100000:1.0:1788970532.902773:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335488 00000100:00100000:1.0:1788970532.902776:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335488 00000100:00100000:1.0:1788970532.902788:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336000 00000100:00100000:1.0:1788970532.902791:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336000 00000100:00100000:1.0:1788970532.902804:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334976 00000100:00100000:1.0:1788970532.902815:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334976 00000100:00100000:1.0:1788970532.902832:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335616 00000100:00100000:1.0:1788970532.902834:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335616 00000100:00100000:1.0:1788970532.902851:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970532.902860:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102335872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.902913:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102335872:12345-0@lo:400:kworker.0 Request processed in 54us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.902920:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970532.902936:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970532.902943:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102335488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.902971:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102335488:12345-0@lo:400:kworker.0 Request processed in 29us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.902977:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970532.902988:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970532.902994:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102336000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.903022:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102336000:12345-0@lo:400:kworker.0 Request processed in 28us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.903028:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970532.903039:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970532.903044:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102334976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.903069:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102334976:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.903075:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970532.903085:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970532.903092:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.903117:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102335616:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.903130:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788970532.903149:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334592 00000100:00100000:1.0:1788970532.903153:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334592 00000100:00100000:1.0:1788970532.903174:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335104 00000100:00100000:1.0:1788970532.903177:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335104 00000100:00100000:1.0:1788970532.903189:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970532.903195:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.903227:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102334592:12345-0@lo:400:kworker.0 Request processed in 32us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.903233:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970532.903245:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970532.903250:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102335104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.903291:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102335104:12345-0@lo:400:kworker.0 Request processed in 40us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.903296:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788970532.903436:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102335104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.903446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102335744:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.903470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788970532.903498:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4780 x1875871102334976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970532.903508:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102334976:0@lo:400:kworker.0 00010000:00080000:0.0:1788970532.903517:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83568780 x1875871102335616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970532.903525:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102335616:0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.903561:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335744 00000100:00100000:0.0:1788970532.903565:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335744 00000100:00100000:0.0:1788970532.903592:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970532.903675:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335232 00000100:00100000:1.0:1788970532.903679:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335232 00000100:00100000:1.0:1788970532.903701:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334720 00000100:00100000:1.0:1788970532.903704:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334720 00000100:00100000:1.0:1788970532.903712:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334848 00000100:00100000:1.0:1788970532.903714:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334848 00000100:00100000:1.0:1788970532.903722:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102335360 00000100:00100000:1.0:1788970532.903724:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102335360 00000100:00100000:1.0:1788970532.903731:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970532.903738:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102335232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.903785:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102335232:12345-0@lo:400:kworker.0 Request processed in 47us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.903791:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970532.903811:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970532.903815:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875871102334720:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788970532.903853:0:18656:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1788970532.903880:0:18656:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6fcc8 00002000:00100000:1.0:1788970532.903893:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a7eaa731800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788970532.903897:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788970532.903900:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788970532.904214:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102335744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970532.904262:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102335744:12345-0@lo:400:kworker.0 Request processed in 45us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970532.904269:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970532.904298:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970532.904303:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102334848:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788970532.905791:0:19264:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1788970532.905821:0:19264:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c6fccf 00002000:00100000:0.0:1788970532.905835:0:19264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a7eb0c24800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788970532.905839:0:19264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788970532.905841:0:19264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970532.906011:0:19264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788970532.906035:0:19264:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c23000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970532.906120:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102334848:12345-0@lo:8:kworker.0 Request processed in 1813us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970532.906130:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970532.906157:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970532.906162:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102335360:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788970532.906183:0:19264:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1788970532.906197:0:19264:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c6fcd6 00002000:00100000:0.0:1788970532.906203:0:19264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a7eb0c27000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788970532.906207:0:19264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788970532.906215:0:19264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970532.906241:0:19264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788970532.906265:0:19264:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c26000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970532.906300:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102335360:12345-0@lo:8:kworker.0 Request processed in 137us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970532.906308:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00002000:00080000:1.0:1788970532.906468:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788970532.906485:0:18656:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa731000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970532.906521:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102334720:12345-0@lo:8:kworker.0 Request processed in 2703us (4323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.906528:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970532.906557:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102334464 00000100:00100000:1.0:1788970532.906563:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102334464 00000100:00100000:1.0:1788970532.906671:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788970532.906679:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102334464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.906714:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102334464:12345-0@lo:400:kworker.0 Request processed in 36us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.906720:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788970532.906754:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970532.906759:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970532.906762:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970532.906826:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102334592:0@lo:400:kworker.0 00010000:00080000:1.0:1788970532.906842:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4b40 x1875871102335488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.906853:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102335488:0@lo:400:kworker.0 00010000:00080000:1.0:1788970532.906881:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8356a940 x1875871102336000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.906889:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102336000:0@lo:400:kworker.0 00000100:00100000:1.0:1788970532.906897:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102334464:0@lo:400:kworker.0 00010000:00080000:1.0:1788970532.906907:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee6940 x1875871102335232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.906914:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102335232:0@lo:400:kworker.0 00010000:00080000:1.0:1788970532.906924:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83568000 x1875871102335872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.906931:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102335872:0@lo:400:kworker.0 00010000:00080000:1.0:1788970532.907011:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83569680 x1875871102335744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.907020:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102335744:0@lo:400:kworker.0 00010000:00080000:1.0:1788970532.907049:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4f00 x1875871102334720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.907056:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970532.907062:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788970532.907070:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788970532.907075:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788970532.907078:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788970532.907106:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788970532.907110:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102334720:0@lo:8:kworker.0 00010000:00080000:1.0:1788970532.907132:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee43c0 x1875871102334848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.907139:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970532.907143:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788970532.907147:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788970532.907149:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788970532.907151:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788970532.907161:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788970532.907164:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102334848:0@lo:8:kworker.0 00010000:00080000:1.0:1788970532.907174:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee5e00 x1875871102335360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970532.907181:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788970532.907185:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788970532.907188:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788970532.907189:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788970532.907200:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788970532.907204:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102335360:0@lo:8:kworker.0 00000004:00080000:1.0:1788970532.907268:0:17177:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000004:00080000:2.0:1788970532.907270:0:17175:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788970532.907295:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fed680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875871102336384:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788970532.907296:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dde1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875871102336512:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788970532.907339:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970532.907365:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708a780 going to sleep for 11 seconds 00000004:00080000:2.0:1788970532.907411:0:17174:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788970532.907420:0:19264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336512 00000100:00100000:0.0:1788970532.907426:0:19264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336512 00000100:00100000:0.0:1788970532.907462:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970532.907470:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17175:x1875871102336512:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788970532.907485:0:17174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 552174102495ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788970532.907493:0:17174:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788970532.907522:0:17893:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788970532.907587:0:17893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 552174205523ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788970532.907593:0:17893:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1788970532.908793:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788970532.908837:0:17894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788970532.908868:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875871102336768:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788970532.908914:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970532.908939:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708a540 going to sleep for 11 seconds 00000004:00080000:2.0:1788970532.908977:0:17176:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788970532.909047:0:17176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 552175664774ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788970532.909055:0:17176:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788970532.909794:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970532.909817:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970532.909836:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102336128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970532.909864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970532.909888:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970532.909895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102336256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970532.909929:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970532.909965:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336768 00000100:00100000:1.0:1788970532.909973:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336768 00000100:00100000:1.0:1788970532.910013:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336384 00000100:00100000:1.0:1788970532.910017:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336384 00000100:00100000:1.0:1788970532.910036:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970532.910044:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1875871102336768:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788970532.910336:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102336640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970532.910367:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970532.910423:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336128 00000100:00100000:1.0:1788970532.910427:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336128 00000100:00100000:1.0:1788970532.910445:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336256 00000100:00100000:1.0:1788970532.910447:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336256 00000100:00100000:1.0:1788970532.910456:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336640 00000100:00100000:1.0:1788970532.910458:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336640 00000100:00100000:1.0:1788970532.910467:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970532.910472:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102336128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970532.910489:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788970532.910529:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102336128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.910535:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970532.910549:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970532.910554:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102336256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970532.910567:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970532.910591:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102336256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.910596:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970532.910616:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970532.910623:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875871102336640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970532.910632:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788970532.910659:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875871102336640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.910664:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788970532.910697:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83dded00 x1875871102336256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.910715:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102336256:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788970532.910726:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83fec3c0 x1875871102336128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.910737:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102336128:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788970532.910764:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83dde580 x1875871102336640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970532.910775:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102336640:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788970532.910789:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788970532.912677:0:19264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788970532.912690:0:19264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788970532.912696:0:19264:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1788970532.913468:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788970532.921372:0:18656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788970532.921400:0:18656:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788970532.921493:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1875871102336768:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11445us (12575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970532.921506:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970532.921547:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970532.921559:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17177:x1875871102336384:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1788970532.922028:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ddc780 x1875871102336768/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970548 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970532.922044:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875871102336768:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788970532.922057:0:17894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788970532.922102:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875871102336896:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788970532.922145:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970532.922176:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970532.923192:0:18653:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788970532.923204:0:18653:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788970532.924602:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102336896 00000100:00100000:1.0:1788970532.924613:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102336896 00000004:00080000:2.0:1788970532.925392:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788970532.925419:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788970532.925514:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970532.925526:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17894:x1875871102336896:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788970532.925556:0:19710:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788970532.925633:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17894:x1875871102336896:12345-0@lo:5:osp-pre-1-1.0 Request processed in 110us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970532.925640:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788970532.925682:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ddc780 x1875871102336896/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970548 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970532.925697:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875871102336896:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788970532.925711:0:17894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788970532.925758:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875871102337024:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788970532.925789:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970532.925815:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970532.925837:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337024 00000100:00100000:2.0:1788970532.925841:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337024 00000100:00100000:2.0:1788970532.925865:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970532.925871:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17894:x1875871102337024:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788970532.925896:0:19710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:1.0:1788970532.931769:0:18656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788970532.931794:0:18656:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788970532.931800:0:18656:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:0.0:1788970532.940086:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.940099:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.940116:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.940121:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.940127:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.940144:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.940167:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.940189:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.940213:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.941178:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.941188:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.941199:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.941203:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.941212:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.941232:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.941239:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb7e375/0xc3abfebe76c6fcdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.941276:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.941284:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.941286:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.941966:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.941975:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.941989:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.941993:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.941999:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942010:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942019:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942026:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942043:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970532.942522:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.942530:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942545:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.942548:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.942552:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942561:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942568:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942575:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942590:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970532.942599:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970532.942604:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942611:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.942615:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942624:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942648:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942656:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e564241/0xc3abfebe76c6fce4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942675:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.942678:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942685:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.942688:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942695:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942704:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942712:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bf2fa05/0xc3abfebe76c6fceb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.942724:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.942725:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.942733:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.943281:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.945436:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.945449:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945466:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.945471:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.945477:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945489:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945499:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945506:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945532:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.945548:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.945553:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945560:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.945564:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945588:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945603:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945610:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107a2f6a/0xc3abfebe76c6fcf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.945630:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.945633:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.945634:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.949459:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.949474:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949490:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.949494:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.949499:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949513:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949523:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949543:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949561:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.949574:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.949580:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949587:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae012000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.949592:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949601:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949616:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949623:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba64b2e/0xc3abfebe76c6fcf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.949642:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.949644:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.949646:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.952300:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.952331:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.952348:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.952352:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.952358:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.952373:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.952400:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.952409:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.952427:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970532.952677:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970532.952685:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.952693:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970532.952698:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.952719:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.952738:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.952746:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e93f778/0xc3abfebe76c6fd00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.952764:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970532.952766:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970532.952767:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.956730:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.956743:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.956760:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.956765:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.956772:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.956791:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.956801:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.956810:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.956826:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970532.957004:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.957011:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957030:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.957033:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.957037:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957049:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957058:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957066:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957079:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970532.957555:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970532.957563:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957573:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.957578:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957589:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957616:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957624:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fd07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957643:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.957646:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957652:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.957655:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957662:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957672:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957679:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fd0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.957690:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.957691:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.957698:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.957704:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.957892:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.957900:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957909:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.957912:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.957916:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957925:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957944:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957951:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.957966:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970532.958512:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970532.958519:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.958530:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970532.958534:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.958543:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.958559:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.958580:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b05b4909/0xc3abfebe76c6fd15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.958597:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970532.958600:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970532.958601:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.959035:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.959042:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959051:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.959055:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.959060:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959071:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959080:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959087:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959103:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.959111:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.959116:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959123:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.959126:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959147:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959165:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959173:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d0c5f1/0xc3abfebe76c6fd1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.959189:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.959191:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.959192:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.959492:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.959499:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.959507:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.959511:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.959514:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.959524:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.959532:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.959538:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.959564:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.960020:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.960027:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960037:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.960041:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960049:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960062:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960082:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fd23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960098:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.960100:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.960101:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.960290:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.960296:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960306:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.960309:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.960324:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960334:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960343:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960350:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960366:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970532.960373:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.960377:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960406:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.960416:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960425:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960437:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960444:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fd2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.960458:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.960460:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.960462:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.960798:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.960805:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960814:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.960817:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.960821:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960829:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960836:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960843:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960856:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.960862:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.960870:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960877:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.960880:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960889:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960900:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960907:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c6fd31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.960921:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.960923:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.960924:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.961214:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.961221:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.961230:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.961233:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.961237:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.961247:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.961267:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.961281:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.961296:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.961703:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.961709:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.961717:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.961720:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.961740:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.961751:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.961758:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fd38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.961772:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.961774:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.961776:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.963558:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.963570:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.963586:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.963590:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.963595:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.963607:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.963617:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.963624:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.963649:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.963686:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.963695:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.963704:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.963709:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.963720:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.963741:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.963750:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088340be2/0xc3abfebe76c6fd3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.963772:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.963774:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.963776:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.963902:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.963910:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.963918:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.963921:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.963925:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.963934:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.963942:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.963957:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.963976:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970532.964467:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.964474:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964482:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.964485:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.964489:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964498:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964507:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964514:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964534:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788970532.964623:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970532.964630:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964639:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.964648:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964657:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964670:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964679:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c6fd46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964697:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.964698:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.964701:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964708:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.964711:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964718:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964727:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964734:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000755955fd/0xc3abfebe76c6fd4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964758:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.964760:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.964762:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.964765:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.964772:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964785:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.964788:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.964792:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964802:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964810:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964818:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.964838:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.964913:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.964920:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964928:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.964932:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964939:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.964951:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965031:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087991172/0xc3abfebe76c6fd54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965047:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.965048:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.965050:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.965206:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.965212:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965220:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.965223:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.965227:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965235:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965265:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965272:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965293:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970532.965548:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.965561:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.965569:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.965572:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.965576:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.965585:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.965593:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.965601:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.965619:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788970532.965706:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970532.965713:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965732:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.965737:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965740:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.965748:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965750:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965768:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.965773:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965778:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965783:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965790:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013998c95/0xc3abfebe76c6fd5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.965801:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965809:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.965811:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ccf3a66/0xc3abfebe76c6fd62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.965812:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.965815:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.965832:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.965840:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.965842:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970532.966103:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970532.966109:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.966117:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788970532.966120:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.966125:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.966134:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.966142:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.966148:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970532.966274:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.966280:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.966288:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.966291:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.966295:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.966304:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.966423:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.966431:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.967055:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.967067:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.967074:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.967083:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.967088:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.967110:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.967125:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.967544:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7679c0/0xc3abfebe76c6fd70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.967568:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.967570:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.967572:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.968354:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.968367:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.968373:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.968397:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.968401:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.968425:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.968440:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.968448:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179a39b9/0xc3abfebe76c6fd69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.968463:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.968464:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.968466:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970532.970093:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.970103:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.970118:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.970123:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.970129:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.970141:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970532.970658:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.970666:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.970677:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.970681:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.970685:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.970696:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.970704:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.970712:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.970729:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.971214:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.971222:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.971231:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.971236:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.971246:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.971273:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.971294:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d45e1ef2/0xc3abfebe76c6fd7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.971318:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.971320:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.971322:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970532.971434:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.971447:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.972280:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.972295:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.972302:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.972314:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.972319:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.972330:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.972346:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.972362:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fd77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970532.972450:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.972456:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972464:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.972467:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.972470:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972478:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972483:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972488:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972496:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.972838:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.972844:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.972853:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.972857:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.972865:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970532.972869:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.972874:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.972877:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972882:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.972885:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970532.972885:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d315322/0xc3abfebe76c6fd85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972889:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.972906:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.972908:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.972909:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.972910:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.972917:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972924:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.972939:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.972945:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.972945:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788970532.972949:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.972957:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.973213:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.973225:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.973239:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.973246:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ce846c/0xc3abfebe76c6fd8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970532.973262:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.973269:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.973271:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.973275:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.973278:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.973282:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.973286:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.973290:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973299:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973307:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973328:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973344:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970532.973353:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.973357:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973364:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9be00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.973368:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973375:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973402:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973408:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fd93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973420:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.973422:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.973423:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.973830:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.973843:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973853:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.973856:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.973859:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973868:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973876:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973883:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973898:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970532.973906:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.973910:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973918:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9aa00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.973921:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973929:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973945:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973952:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fd9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.973965:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.973967:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.973968:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970532.974750:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.974759:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.974775:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.974779:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.974783:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.974795:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.974804:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.974811:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.974830:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970532.974988:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.974995:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.975004:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.975008:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.975017:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.975029:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.975036:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fda1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.975051:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.975052:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.975054:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.977190:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.977201:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.977216:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.977220:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.977225:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.977237:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.977245:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.977252:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.977296:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970532.978583:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.978594:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978607:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.978611:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.978617:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978630:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978640:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978648:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978663:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970532.978674:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970532.978679:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978686:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ba00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.978697:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978706:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978723:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978732:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fda8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978749:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.978753:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978759:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ae00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.978763:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978771:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978781:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978789:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.978809:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.978811:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.978813:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970532.979143:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.979156:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.979166:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.979170:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.979174:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.979185:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.979203:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.979210:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.979229:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.979343:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.979351:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979367:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.979499:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979509:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979523:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979530:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032eb261b/0xc3abfebe76c6fdb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979554:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.979556:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.979558:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.979585:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.979592:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.979600:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.979603:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.979607:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.979616:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.979623:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.979630:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.979647:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970532.979672:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970532.979679:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979689:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.979693:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979702:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979722:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979729:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069391d57/0xc3abfebe76c6fdbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.979743:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.979744:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.979746:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970532.980067:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970532.980074:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980082:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788970532.980085:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970532.980090:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980099:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980106:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980112:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980136:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970532.980185:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.980191:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980209:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.980211:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.980215:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980223:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980230:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980237:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980252:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970532.980405:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970532.980414:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.980418:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980425:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.980428:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980435:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980458:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980466:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fdcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.980479:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.980482:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.980483:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.980626:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980634:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970532.980638:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980645:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980656:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980663:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006400a994/0xc3abfebe76c6fdc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970532.980677:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.980679:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970532.980681:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.980689:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.981272:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.981279:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981290:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.981294:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.981299:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981311:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981318:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981325:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981351:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970532.981359:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970532.981364:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981370:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970532.981374:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981398:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981410:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981417:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fdd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.981431:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.981433:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.981435:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970532.987394:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.987410:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.987429:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.987441:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.987448:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.987462:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.987474:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.987482:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.987501:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970532.989305:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.989319:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.989335:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.989341:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.989347:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.989359:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.989368:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970532.989498:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.989505:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.989513:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.989516:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.989520:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.989530:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.989538:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.989546:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.989580:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788970532.989979:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.989985:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.989994:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.989997:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.990001:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990010:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990017:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990023:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990038:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788970532.990311:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.990317:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990326:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.990334:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.990338:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990347:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990354:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990360:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990367:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788970532.990634:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.990644:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788970532.990919:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.990925:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990934:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.990937:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.990941:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990949:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990956:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990969:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.990978:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788970532.991231:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.991237:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.991245:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.991248:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.991252:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.991275:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.991283:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.991290:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.991298:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788970532.991555:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.991562:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.991571:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.991574:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.991578:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.991588:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.991596:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.991604:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.991613:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1788970532.991857:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788970532.991865:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991872:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ae00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.991877:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991895:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991912:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991920:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b996a4bc/0xc3abfebe76c6fdd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991937:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788970532.991941:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991946:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.991949:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991956:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991965:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991972:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d1d1679/0xc3abfebe76c6fde7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.991995:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788970532.991999:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992005:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.992008:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992015:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992024:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992031:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026d90c2/0xc3abfebe76c6fdee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992042:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788970532.992045:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992051:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.992054:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992073:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992083:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992090:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c6fdf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992103:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788970532.992107:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992114:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ba00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.992116:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992124:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992132:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.992139:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f1707d/0xc3abfebe76c6fde0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970532.992297:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.992303:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.992318:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.992322:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.992326:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.992336:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.992344:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.992351:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.992360:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788970532.992678:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970532.992685:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.992700:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970532.992702:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970532.992706:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.992715:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.992723:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.992730:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970532.992739:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000001:00080000:2.0:1788970532.993119:0:19469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788970532.993143:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788970532.993147:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788970532.996121:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788970532.996128:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996138:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.996143:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996152:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996172:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996179:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bace06d/0xc3abfebe76c6fdfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996194:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788970532.996197:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996203:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.996206:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996226:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996236:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996243:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc954bd/0xc3abfebe76c6fe03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996265:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788970532.996269:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996276:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9aa00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.996278:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996286:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996297:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996303:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6828a5c/0xc3abfebe76c6fe0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996325:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970532.996328:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996334:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.996337:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996344:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996352:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996358:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c6fe11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996369:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970532.996372:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996377:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9be00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970532.996400:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996417:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996427:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996435:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8511cb1/0xc3abfebe76c6fe18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970532.996448:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.996450:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970532.996452:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970532.996594:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17894:x1875871102337024:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70720us (70801us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788970532.996603:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788970532.996687:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970532.996694:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970532.997676:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970532.997687:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.997703:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970532.997708:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970532.997714:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.997728:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.997752:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.997761:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970532.997783:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970533.000618:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970533.000633:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000651:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970533.000655:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970533.000661:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000689:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000698:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000705:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000723:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970533.000902:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970533.000910:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000919:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.000924:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000933:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000949:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000956:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c6fe1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000983:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970533.000987:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.000993:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.000996:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001004:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001014:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001020:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad086c81/0xc3abfebe76c6fe26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001030:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.001032:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.001034:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.001041:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970533.001848:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970533.001859:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001870:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970533.001883:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970533.001888:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001899:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001908:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001915:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.001931:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970533.002971:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970533.002982:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970533.002997:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788970533.003002:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970533.003006:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970533.003018:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970533.003026:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970533.003034:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970533.003069:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788970533.004459:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970533.004471:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004487:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970533.004491:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970533.004495:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004508:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004517:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004532:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004552:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788970533.004719:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788970533.004728:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004736:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.004741:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004750:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004765:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004773:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000558af82f/0xc3abfebe76c6fe2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004789:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970533.004793:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004811:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.004814:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004823:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004835:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004842:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c6fe34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004861:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970533.004865:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004871:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.004875:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004882:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004891:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004903:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000862e5f86/0xc3abfebe76c6fe3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.004915:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.004916:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.004918:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.004925:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970533.005640:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970533.008496:0:19264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970533.008510:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008527:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970533.008531:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970533.008536:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008550:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008559:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008567:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008583:0:19264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788970533.008671:0:19264:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1788970533.008760:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17175:x1875871102336512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101288us (101416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970533.008770:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788970533.008807:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970533.008813:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008821:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9bc00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.008825:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008835:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008850:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008858:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c6fe42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008874:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.008876:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.008877:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970533.008920:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970533.008926:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008945:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970533.008948:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970533.008952:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008962:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008969:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008976:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.008989:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970533.009169:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970533.009174:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.009182:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.009186:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.009194:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970533.009537:0:17894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788970533.009555:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875871102337024:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788970533.009571:0:17894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788970533.009620:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1875871102337152:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788970533.009661:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970533.009688:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970533.009723:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dde1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875871102336512:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788970533.009731:0:17175:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788970533.009755:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dde1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875871102337280:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788970533.009778:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970533.009795:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970533.009815:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337152 00000100:00100000:2.0:1788970533.009821:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337152 00000100:00100000:2.0:1788970533.009862:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970533.009870:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1875871102337152:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788970533.009918:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1875871102337152:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970533.009925:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970533.009945:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337280 00000100:00100000:2.0:1788970533.009949:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337280 00000100:00100000:2.0:1788970533.009971:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970533.009978:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17175:x1875871102337280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788970533.010009:0:18654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00080000:2.0:1788970533.010130:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ddc780 x1875871102337152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970533.010142:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1875871102337152:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788970533.013742:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.013751:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a861cb5/0xc3abfebe76c6fe49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.013776:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.013778:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.013780:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970533.015087:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970533.015097:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.015111:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=552s v=(0 0) 00010000:00010000:1.0:1788970533.015115:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970533.015121:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.015134:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.015144:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.015164:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.015196:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970533.015500:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970533.015508:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015518:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ac00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970533.015522:0:19487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015531:0:19487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015546:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015553:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c6fe50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015571:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970533.015572:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970533.015574:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970533.015945:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970533.015952:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015962:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788970533.015966:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970533.015970:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015988:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.015998:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.016006:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970533.016021:0:18656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788970533.016061:0:18656:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1788970533.016143:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17177:x1875871102336384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94585us (106348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970533.016164:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970533.016322:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83fed680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875871102336384:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788970533.016337:0:17177:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788970533.016401:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875871102337408:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788970533.016436:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970533.016464:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82e6f840 going to sleep for 11 seconds 00010000:00010000:1.0:1788970533.016476:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970533.016481:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.016489:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970533.016492:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.016501:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.016514:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.016522:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c6fe57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970533.016536:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.016544:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970533.016546:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970533.017068:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337408 00000100:00100000:0.0:1788970533.017075:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337408 00000100:00100000:0.0:1788970533.017123:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788970533.017132:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17177:x1875871102337408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788970533.017250:0:19710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:1.0:1788970533.024357:0:18650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788970533.024433:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788970533.024629:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17175:x1875871102337280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14647us (14845us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788970533.024640:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970533.024735:0:17175:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788970533.024744:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dde1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875871102337280:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788970533.024758:0:17175:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1788970533.027775:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17177:x1875871102337408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10638us (11332us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788970533.027788:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970533.030395:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875871102337408:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788970533.030416:0:17177:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788970533.597687:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970534.620528:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788970534.811635:0:19827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788970535.645997:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970535.710224:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970535.710267:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102337536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970535.710422:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970535.710827:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337536 00000100:00100000:2.0:1788970535.710838:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337536 00000100:00100000:2.0:1788970535.710909:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970535.710921:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102337536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970535.710962:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788970535.711473:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970535.711618:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102337536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 698us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970535.711649:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970535.712067:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102337536:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788970535.990522:0:19880:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970535.991094:0:19880:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970536.674065:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970536.735888:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970536.735911:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102337664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970536.735980:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970536.736097:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337664 00000100:00100000:2.0:1788970536.736106:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337664 00000100:00100000:2.0:1788970536.736152:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970536.736161:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102337664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970536.736192:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788970536.736264:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102337664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970536.736270:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970536.736592:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102337664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970536.737516:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102337792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970536.737565:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970536.738486:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337792 00000100:00100000:2.0:1788970536.738496:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337792 00000100:00100000:2.0:1788970536.738545:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970536.738552:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102337792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970536.738582:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788970536.738638:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102337792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970536.738644:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970536.738764:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102337792:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788970536.937077:0:19930:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970536.937329:0:19930:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788970537.167274:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.167369:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333312 00000100:00100000:3.0:1788970537.167424:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333312 00000100:00100000:3.0:1788970537.167470:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:3.0:1788970537.167493:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875871082333312:12345-192.168.203.15@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788970537.167520:0:17145:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f0216bee-468c-4e54-8bfe-6d61bf429fa4@192.168.203.15@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788970537.167549:0:17145:0:(genops.c:1384:class_connect()) connect: client f0216bee-468c-4e54-8bfe-6d61bf429fa4, cookie 0xc3abfebe76c6fe5e 00000100:00080000:3.0:1788970537.167674:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8a7d8368b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970537.167733:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+5:2399:x1875871082333312:12345-192.168.203.15@tcp:250:mount.lustre.0 Request processed in 240us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.167741:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:1.0:1788970537.171522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970537.173999:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333440 00000100:00100000:2.0:1788970537.174016:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333440 00000100:00100000:2.0:1788970537.174089:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:2.0:1788970537.174101:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+5:14880:x1875871082333440:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970537.174118:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970537.174147:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9600/0xc3abfebe76c6fe65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db3a expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970537.174194:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9600/0xc3abfebe76c6fe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db3a expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970537.174207:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9600/0xc3abfebe76c6fe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db3a expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970537.174215:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9600, rc 0) 00000100:00100000:2.0:1788970537.174356:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+6:14880:x1875871082333440:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 257us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970537.174363:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:0.0:1788970537.183354:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.183524:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333568 00000100:00100000:3.0:1788970537.183536:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333568 00000100:00100000:3.0:1788970537.183596:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:3.0:1788970537.183607:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+6:14880:x1875871082333568:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788970537.183722:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+6:14880:x1875871082333568:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 117us (379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970537.183730:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:3.0:1788970537.191267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.196291:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333696 00000100:00100000:1.0:1788970537.196308:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333696 00000100:00100000:1.0:1788970537.196401:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1788970537.196413:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+6:14880:x1875871082333696:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970537.196430:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970537.196449:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6fe6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db41 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.196477:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6fe6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db41 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.196488:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6fe6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db41 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.196498:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b000, rc 0) 00000100:00100000:1.0:1788970537.196554:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+7:14880:x1875871082333696:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 143us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.196568:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1788970537.200756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970537.201221:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333824 00000100:00100000:2.0:1788970537.201247:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333824 00000100:00100000:2.0:1788970537.201323:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:2.0:1788970537.201335:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+7:14880:x1875871082333824:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970537.201554:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14880:x1875871082333824:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 221us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970537.201563:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:0.0:1788970537.210126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.210314:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082333952 00000100:00100000:3.0:1788970537.210334:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082333952 00000100:00100000:3.0:1788970537.210478:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:3.0:1788970537.210491:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14880:x1875871082333952:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788970537.211509:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14880:x1875871082333952:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 1014us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.211529:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:2.0:1788970537.225523:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.227062:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334080 00000100:00100000:1.0:1788970537.227082:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334080 00000100:00100000:1.0:1788970537.227369:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1788970537.227560:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14898:x1875871082334080:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970537.227791:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14898:x1875871082334080:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 235us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.228891:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:1.0:1788970537.262903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.263066:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334208 00000100:00100000:3.0:1788970537.263081:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334208 00000100:00100000:3.0:1788970537.263348:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:3.0:1788970537.263443:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14898:x1875871082334208:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970537.263788:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14898:x1875871082334208:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 349us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.263797:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:0.0:1788970537.277533:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.278055:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334336 00000100:00100000:1.0:1788970537.278072:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334336 00000100:00100000:1.0:1788970537.278162:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:1.0:1788970537.278175:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14898:x1875871082334336:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970537.278680:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14898:x1875871082334336:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 506us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.278689:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:2.0:1788970537.290334:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.290444:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334464 00000100:00100000:3.0:1788970537.290457:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334464 00000100:00100000:3.0:1788970537.290525:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:3.0:1788970537.290540:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:14880:x1875871082334464:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788970537.290564:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970537.290601:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fe73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db72 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970537.290643:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fe73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db72 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970537.290657:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fe73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db72 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970537.290669:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3800, rc 0) 00000100:00100000:3.0:1788970537.290737:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+9:14880:x1875871082334464:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.290745:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:2.0:1788970537.294218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.294409:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334592 00000100:00100000:1.0:1788970537.294424:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334592 00000100:00100000:1.0:1788970537.294495:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:1.0:1788970537.294507:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+9:14880:x1875871082334592:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788970537.294547:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788970537.294582:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788970537.294587:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788970537.294590:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788970537.294715:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788970537.294718:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788970537.299810:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+9:14880:x1875871082334592:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 5284us (5586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.299832:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:2.0:1788970537.311990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.312086:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334720 00000100:00100000:1.0:1788970537.312118:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334720 00000100:00100000:1.0:1788970537.312276:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:1.0:1788970537.312289:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+9:14880:x1875871082334720:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970537.312313:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970537.312340:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8db79 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.312378:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 10 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.312416:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 10 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.312427:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a800, rc 0) 00000100:00100000:1.0:1788970537.312635:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14880:x1875871082334720:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 347us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.312644:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:3.0:1788970537.317919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.319456:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334848 00000100:00100000:1.0:1788970537.319483:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334848 00000100:00100000:1.0:1788970537.319579:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:1.0:1788970537.319593:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14880:x1875871082334848:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788970537.319831:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14880:x1875871082334848:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 241us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.319840:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:0.0:1788970537.323037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.323161:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082334976 00000100:00100000:1.0:1788970537.323174:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082334976 00000100:00100000:1.0:1788970537.323310:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:1.0:1788970537.323323:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14880:x1875871082334976:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788970537.323601:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14880:x1875871082334976:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 279us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.323610:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:2.0:1788970537.330978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.338132:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335104 00000100:00100000:3.0:1788970537.338165:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335104 00000100:00100000:3.0:1788970537.338281:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:3.0:1788970537.338294:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14903:x1875871082335104:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970537.338598:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14903:x1875871082335104:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 305us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.338608:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:3.0:1788970537.342661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.342872:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335232 00000100:00100000:1.0:1788970537.342887:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335232 00000100:00100000:1.0:1788970537.343059:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:1.0:1788970537.343073:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14903:x1875871082335232:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970537.343513:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:14903:x1875871082335232:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 441us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.343523:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:3.0:1788970537.357063:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.357193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970537.358180:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335360 00000100:00100000:2.0:1788970537.358198:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335360 00000100:00100000:2.0:1788970537.358283:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335616 00000100:00100000:2.0:1788970537.358287:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335616 00000100:00100000:2.0:1788970537.358336:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970537.358347:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875871082335360:12345-192.168.203.15@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788970537.358412:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:3.0:1788970537.358420:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875871082335616:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788970537.358426:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 76f5674c-81e4-444b-a7b0-2ac4d1e4da63@192.168.203.15@tcp t0 exp 0000000000000000 cur 556 last 0 00010000:00080000:3.0:1788970537.358445:0:19483:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 76f5674c-81e4-444b-a7b0-2ac4d1e4da63@192.168.203.15@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788970537.358516:0:19483:0:(genops.c:1384:class_connect()) connect: client 76f5674c-81e4-444b-a7b0-2ac4d1e4da63, cookie 0xc3abfebe76c6fe81 00000004:00100000:3.0:1788970537.358552:0:19483:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000020:00000080:2.0:1788970537.358564:0:17151:0:(genops.c:1384:class_connect()) connect: client 76f5674c-81e4-444b-a7b0-2ac4d1e4da63, cookie 0xc3abfebe76c6fe88 00000004:00100000:2.0:1788970537.358583:0:17151:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788970537.359083:0:19483:0:(import.c:65:import_set_state_nolock()) ffff8a7d8368d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970537.359347:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2399:x1875871082335616:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 924us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.359357:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00080000:2.0:1788970537.360602:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8a7d83ef9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970537.360668:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2399:x1875871082335360:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 2318us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970537.360680:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970537.385172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970537.385215:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970537.385327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970537.385436:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335872 00000100:00100000:0.0:1788970537.385450:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335872 00000100:00100000:0.0:1788970537.385543:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335488 00000100:00100000:0.0:1788970537.385547:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335488 00000100:00100000:0.0:1788970537.385562:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082335744 00000100:00100000:0.0:1788970537.385564:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082335744 00000100:00100000:0.0:1788970537.385584:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:0.0:1788970537.385595:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:14880:x1875871082335872:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970537.385636:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788970537.385750:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:14880:x1875871082335872:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 156us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970537.385759:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:0.0:1788970537.385782:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:0.0:1788970537.385789:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:0:x1875871082335488:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970537.385801:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788970537.385830:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:0:x1875871082335488:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 42us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970537.385836:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:0.0:1788970537.385848:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:0.0:1788970537.385855:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:0:x1875871082335744:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970537.385867:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970537.385906:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:0:x1875871082335744:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 51us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970537.385932:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00080000:2.0:1788970537.387370:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970537.387423:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970537.397841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970537.401123:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336000 00000100:00100000:0.0:1788970537.401144:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336000 00000100:00100000:1.0:1788970537.401544:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:1.0:1788970537.401558:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14880:x1875871082336000:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788970537.401691:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14880:x1875871082336000:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 134us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.401699:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:0.0:1788970537.406471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970537.406522:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970537.406553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970537.407474:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336384 00000100:00100000:2.0:1788970537.407491:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336384 00000100:00100000:2.0:1788970537.407581:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1788970537.407595:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14880:x1875871082336384:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788970537.408090:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14880:x1875871082336384:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 496us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970537.408099:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:1.0:1788970537.408558:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336128 00000100:00100000:1.0:1788970537.408567:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336128 00000100:00100000:1.0:1788970537.408602:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336256 00000100:00100000:1.0:1788970537.408605:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336256 00000100:00100000:1.0:1788970537.408702:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:1.0:1788970537.408710:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875871082336128:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788970537.408747:0:18653:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 76f5674c-81e4-444b-a7b0-2ac4d1e4da63@192.168.203.15@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1788970537.408787:0:18653:0:(genops.c:1384:class_connect()) connect: client 76f5674c-81e4-444b-a7b0-2ac4d1e4da63, cookie 0xc3abfebe76c6fe8f 00002000:00100000:1.0:1788970537.408803:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76f5674c-81e4-444b-a7b0-2ac4d1e4da63/ffff8a7d81a3c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788970537.408847:0:18653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788970537.409084:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970537.409091:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875871082336256:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788970537.409111:0:19264:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 76f5674c-81e4-444b-a7b0-2ac4d1e4da63@192.168.203.15@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1788970537.409194:0:19264:0:(genops.c:1384:class_connect()) connect: client 76f5674c-81e4-444b-a7b0-2ac4d1e4da63, cookie 0xc3abfebe76c6fe96 00002000:00100000:0.0:1788970537.409200:0:19264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76f5674c-81e4-444b-a7b0-2ac4d1e4da63/ffff8a7eb3e10800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970537.409215:0:19264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788970537.409447:0:19264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788970537.409510:0:19264:0:(import.c:65:import_set_state_nolock()) ffff8a7ebdabe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970537.409570:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2399:x1875871082336256:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 477us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970537.409578:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00002000:00080000:1.0:1788970537.410557:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788970537.410591:0:18653:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbacb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970537.411554:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2399:x1875871082336128:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 2836us (5024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.411568:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1788970537.413524:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970537.414747:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336512 00000100:00100000:3.0:1788970537.414764:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336512 00000100:00100000:3.0:1788970537.414845:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:3.0:1788970537.414860:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14880:x1875871082336512:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788970537.423147:0:17153:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7866us 00000004:00200000:3.0:1788970537.450790:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788970537.451022:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14880:x1875871082336512:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 36156us (37502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970537.451057:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:2.0:1788970537.621598:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970537.621882:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336640 00000100:00100000:1.0:1788970537.621896:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336640 00000100:00100000:1.0:1788970537.622242:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1788970537.622256:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14926:x1875871082336640:12345-192.168.203.15@tcp:101:mkdir.0 00010000:00010000:1.0:1788970537.622284:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970537.622318:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6fe9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dbaa expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.622445:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6fea4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.622462:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6fea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.622478:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6fea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970537.622548:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788970537.622552:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970537.622595:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6fea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.622626:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9bc00/0xc3abfebe76c6fe9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbaa expref: 8 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.622667:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6fea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbaa expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970537.622677:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:1.0:1788970537.622681:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970537.622685:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a200, rc 0) 00000100:00100000:1.0:1788970537.622770:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:14926:x1875871082336640:12345-192.168.203.15@tcp:101:mkdir.0 Request processed in 517us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970537.622778:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00010000:00010000:2.0:1788970537.692610:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970538.270288:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970538.270323:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102337920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970538.270573:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970538.270584:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102338048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970538.270784:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102338176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970538.271005:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.271110:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970538.271206:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102337920 00000100:00100000:2.0:1788970538.271232:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102337920 00000100:00100000:2.0:1788970538.271296:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338048 00000100:00100000:2.0:1788970538.271300:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338048 00000100:00100000:2.0:1788970538.271342:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970538.271352:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102337920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970538.271421:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970538.271511:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102337920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970538.271519:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970538.271539:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970538.271546:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102338048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970538.271558:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788970538.271589:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102338048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970538.271597:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788970538.272323:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970538.272329:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970538.272423:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102338048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970538.272763:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.273698:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102337920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970538.274102:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338176 00000100:00100000:2.0:1788970538.274114:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338176 00000100:00100000:2.0:1788970538.274195:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970538.274206:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102338176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970538.274276:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788970538.274365:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102338176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970538.274373:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970538.275131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.275202:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970538.275255:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.275284:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970538.275303:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102339328:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.275329:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970538.275366:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788970538.275372:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102338688:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.275426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.275618:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339328 00000100:00100000:1.0:1788970538.275626:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339328 00000100:00100000:1.0:1788970538.275679:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970538.275690:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102339328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970538.275792:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338816 00000100:00100000:2.0:1788970538.275797:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338816 00000100:00100000:2.0:1788970538.275833:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970538.275840:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102338816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970538.275958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102338176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970538.276015:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338304 00000100:00100000:3.0:1788970538.276019:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338304 00000100:00100000:3.0:1788970538.276053:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788970538.276060:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102338304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.277020:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102339200:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.281946:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102339328:12345-0@lo:400:kworker.0 Request processed in 6244us (6601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.281968:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788970538.282042:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970538.282067:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970538.282071:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970538.282098:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102338432:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.282160:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.282231:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102338944:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.282264:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.282290:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102339456:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.282317:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.282343:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788970538.282351:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102338560:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.282372:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.282417:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102339072:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.282439:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970538.282487:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338944 00000100:00100000:1.0:1788970538.283029:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338944 00000100:00100000:1.0:1788970538.283085:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339456 00000100:00100000:1.0:1788970538.283089:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339456 00000100:00100000:1.0:1788970538.283119:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338560 00000100:00100000:1.0:1788970538.283122:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338560 00000100:00100000:1.0:1788970538.283135:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339072 00000100:00100000:1.0:1788970538.283137:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339072 00000100:00100000:1.0:1788970538.283159:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788970538.283169:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102338944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283260:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102338944:12345-0@lo:400:kworker.0 Request processed in 93us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.283267:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788970538.283285:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788970538.283291:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102339456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283334:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102339456:12345-0@lo:400:kworker.0 Request processed in 44us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.283341:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788970538.283353:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788970538.283359:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102338560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283403:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102338560:12345-0@lo:400:kworker.0 Request processed in 44us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.283410:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788970538.283421:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788970538.283427:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102339072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283487:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102339072:12345-0@lo:400:kworker.0 Request processed in 60us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.283494:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788970538.283528:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970538.283532:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970538.283580:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102338560:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283594:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102339072:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283606:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102338944:0@lo:400:kworker.0 00010000:00080000:1.0:1788970538.283619:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4b40 x1875871102339456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970538.283630:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102339456:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283702:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338688 00000100:00100000:1.0:1788970538.283707:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338688 00000100:00100000:1.0:1788970538.283736:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102338432 00000100:00100000:1.0:1788970538.283747:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102338432 00000100:00100000:1.0:1788970538.283764:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788970538.283786:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102338688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283826:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102338688:12345-0@lo:400:kworker.0 Request processed in 56us (8400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.283832:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788970538.283844:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788970538.283850:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102338432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.283882:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102338432:12345-0@lo:400:kworker.0 Request processed in 32us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.283888:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788970538.283915:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102338432:0@lo:400:kworker.0 00000100:00100000:3.0:1788970538.284859:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102338304:12345-0@lo:400:kworker.0 Request processed in 8791us (9650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970538.284859:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102338816:12345-0@lo:400:kworker.0 Request processed in 9010us (9564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970538.284892:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970538.285014:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788970538.289118:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970538.289230:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.289259:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.289277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102339328:0@lo:400:kworker.0 00000100:00100000:0.0:1788970538.289324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102338688:0@lo:400:kworker.0 00000100:00100000:1.0:1788970538.289571:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339200 00000100:00100000:1.0:1788970538.289581:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339200 00000100:00100000:1.0:1788970538.289692:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970538.289704:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102339200:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788970538.290578:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970538.290710:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102339200:12345-0@lo:400:kworker.0 Request processed in 1006us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970538.290723:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788970538.292006:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee6940 x1875871102339200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970538.292029:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102339200:0@lo:400:kworker.0 00010000:00010000:0.0:1788970538.718009:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788970538.783669:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:00100000:2.0:1788970538.800195:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:00080000:2.0:1788970538.800230:0:19469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788970539.662871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970539.662985:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336768 00000100:00100000:1.0:1788970539.662999:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336768 00000100:00080000:2.0:1788970539.663077:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970539.663096:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:1.0:1788970539.663110:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:14978:x1875871082336768:12345-192.168.203.15@tcp:41:lfs.0 00000004:00000024:1.0:1788970539.663160:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788970539.663290:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:14978:x1875871082336768:12345-192.168.203.15@tcp:41:lfs.0 Request processed in 184us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970539.663316:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970539.670283:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.670539:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082336896 00000100:00100000:3.0:1788970539.670554:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082336896 00000100:00100000:3.0:1788970539.670667:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1788970539.670682:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14978:x1875871082336896:12345-192.168.203.15@tcp:41:lfs.0 00000004:00000024:3.0:1788970539.670751:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788970539.670880:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:14978:x1875871082336896:12345-192.168.203.15@tcp:41:lfs.0 Request processed in 202us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970539.670889:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00080000:2.0:1788970539.673067:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970539.678064:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970539.678361:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337024 00000100:00100000:1.0:1788970539.678375:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337024 00000100:00100000:1.0:1788970539.678587:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970539.678600:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:14978:x1875871082337024:12345-192.168.203.15@tcp:13:lfs.0 00002000:00000024:1.0:1788970539.678646:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970539.678761:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:14978:x1875871082337024:12345-192.168.203.15@tcp:13:lfs.0 Request processed in 163us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970539.678770:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00080000:2.0:1788970539.679163:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970539.683338:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.683646:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337152 00000100:00100000:3.0:1788970539.683660:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337152 00000100:00100000:3.0:1788970539.683797:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1788970539.683813:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:14978:x1875871082337152:12345-192.168.203.15@tcp:13:lfs.0 00002000:00000024:3.0:1788970539.683875:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788970539.684001:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:14978:x1875871082337152:12345-192.168.203.15@tcp:13:lfs.0 Request processed in 192us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970539.684008:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00080000:2.0:1788970539.686420:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788970539.740614:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970539.862160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.862305:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337280 00000100:00100000:3.0:1788970539.862319:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337280 00000100:00100000:3.0:1788970539.862456:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:3.0:1788970539.862469:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:15008:x1875871082337280:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788970539.862671:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970539.862698:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6feab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dbb1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970539.862738:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6feab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbb1 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970539.862752:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6feab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbb1 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970539.862763:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2600, rc 0) 00000100:00100000:3.0:1788970539.862847:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15008:x1875871082337280:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 380us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970539.862855:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:0.0:1788970539.870875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.874422:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337408 00000100:00100000:3.0:1788970539.874507:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337408 00000100:00100000:3.0:1788970539.874609:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:3.0:1788970539.877397:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15008:x1875871082337408:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788970539.878279:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15008:x1875871082337408:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 932us (7415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970539.884752:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:0.0:1788970539.890982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.891606:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337536 00000100:00100000:3.0:1788970539.891620:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337536 00000100:00100000:3.0:1788970539.891699:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1788970539.891713:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15008:x1875871082337536:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788970539.891957:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15008:x1875871082337536:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 245us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970539.891966:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:0.0:1788970539.900631:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.901047:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337664 00000100:00100000:3.0:1788970539.901064:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337664 00000100:00100000:3.0:1788970539.903456:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:3.0:1788970539.903490:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15017:x1875871082337664:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970539.903745:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15017:x1875871082337664:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 273us (3128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970539.903754:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:0.0:1788970539.927708:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970539.927834:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337792 00000100:00100000:1.0:1788970539.927847:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337792 00000100:00100000:1.0:1788970539.927921:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:1.0:1788970539.927942:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15017:x1875871082337792:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970539.928161:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15017:x1875871082337792:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 229us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970539.928169:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:0.0:1788970539.939786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.946326:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082337920 00000100:00100000:3.0:1788970539.946473:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082337920 00000100:00100000:3.0:1788970539.946575:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:3.0:1788970539.946587:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15017:x1875871082337920:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970539.948913:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15017:x1875871082337920:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 2310us (9124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970539.948939:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:0.0:1788970539.958062:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970539.958170:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338048 00000100:00100000:3.0:1788970539.958194:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338048 00000100:00100000:3.0:1788970539.958342:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:3.0:1788970539.958355:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:15008:x1875871082338048:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788970539.958432:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970539.959300:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6feb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dbe2 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970539.959453:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe2 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970539.959471:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe2 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970539.959482:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9200, rc 0) 00000100:00100000:2.0:1788970539.959641:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:15008:x1875871082338048:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 1287us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970539.959650:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:0.0:1788970539.982625:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970539.987626:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338176 00000100:00100000:2.0:1788970539.987652:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338176 00000100:00100000:2.0:1788970539.987891:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:2.0:1788970539.987924:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:15008:x1875871082338176:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788970539.987970:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788970539.987994:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788970539.987999:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788970539.988003:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788970539.988006:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788970539.988008:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788970539.991260:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:15008:x1875871082338176:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 3320us (8632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970539.991282:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:0.0:1788970539.995232:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970539.995451:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338304 00000100:00100000:2.0:1788970539.995465:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338304 00000100:00100000:2.0:1788970539.995594:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:2.0:1788970539.995607:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:15008:x1875871082338304:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970539.995629:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970539.995656:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dbe9 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970539.995694:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970539.995709:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970539.995720:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9800, rc 0) 00000100:00100000:2.0:1788970539.995959:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15008:x1875871082338304:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 353us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970539.995967:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:0.0:1788970540.008860:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970540.009561:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338432 00000100:00100000:2.0:1788970540.009578:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338432 00000100:00100000:2.0:1788970540.009666:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:2.0:1788970540.009678:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8367d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15008:x1875871082338432:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970540.009894:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8367d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15008:x1875871082338432:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 217us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.009903:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:3.0:1788970540.018521:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970540.018772:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338560 00000100:00100000:2.0:1788970540.018787:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338560 00000100:00100000:2.0:1788970540.018868:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:2.0:1788970540.018882:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15008:x1875871082338560:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788970540.019191:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15008:x1875871082338560:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 311us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.019200:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:3.0:1788970540.028239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970540.031702:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338688 00000100:00100000:1.0:1788970540.031723:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338688 00000100:00100000:1.0:1788970540.031817:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:1.0:1788970540.031830:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15021:x1875871082338688:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970540.032642:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15021:x1875871082338688:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 807us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970540.032654:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 142 00000100:00100000:3.0:1788970540.058950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970540.060039:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338816 00000100:00100000:2.0:1788970540.060054:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338816 00000100:00100000:2.0:1788970540.060153:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:2.0:1788970540.060168:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15021:x1875871082338816:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970540.060448:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:15021:x1875871082338816:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 283us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.060458:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:0.0:1788970540.071821:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.071862:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.071902:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.072076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.072102:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970540.072176:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339968 00000100:00100000:2.0:1788970540.072190:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339968 00000100:00100000:2.0:1788970540.072280:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339840 00000100:00100000:2.0:1788970540.072283:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339840 00000100:00100000:2.0:1788970540.072313:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1788970540.072343:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082339968:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970540.072483:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082339968:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 143us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.072502:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1788970540.072521:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1788970540.072528:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082339840:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970540.072554:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082339840:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.072561:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1788970540.079718:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970540.081392:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339712 00000100:00100000:3.0:1788970540.081408:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339584 00000100:00100000:3.0:1788970540.081430:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339584 00000100:00100000:1.0:1788970540.081430:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339712 00000100:00100000:3.0:1788970540.081607:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082338944 00000100:00100000:3.0:1788970540.081612:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082338944 00000100:00100000:3.0:1788970540.081638:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1788970540.081651:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2400:x1875871082339584:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970540.081759:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2400:x1875871082339584:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 109us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970540.081767:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:2.0:1788970540.081862:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:2.0:1788970540.081869:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875871082338944:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788970540.081900:0:17150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7365f4d7-b3e1-4126-9092-d6317f98dfcc@192.168.203.15@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788970540.081953:0:17150:0:(genops.c:1384:class_connect()) connect: client 7365f4d7-b3e1-4126-9092-d6317f98dfcc, cookie 0xc3abfebe76c6fec0 00000004:00100000:2.0:1788970540.081985:0:17150:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788970540.082113:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8a7d83efe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970540.082285:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2399:x1875871082338944:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 414us (10180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.082293:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:2.0:1788970540.083443:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339200 00000100:00100000:2.0:1788970540.083455:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339200 00000100:00100000:2.0:1788970540.083513:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:2.0:1788970540.083521:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875871082339200:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788970540.083551:0:17150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7365f4d7-b3e1-4126-9092-d6317f98dfcc@192.168.203.15@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788970540.083594:0:17150:0:(genops.c:1384:class_connect()) connect: client 7365f4d7-b3e1-4126-9092-d6317f98dfcc, cookie 0xc3abfebe76c6fec7 00000004:00100000:2.0:1788970540.083634:0:17150:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788970540.083741:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970540.083800:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2399:x1875871082339200:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 278us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.083809:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:1.0:1788970540.087435:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:1.0:1788970540.087464:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2400:x1875871082339712:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970540.087717:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970540.087795:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339456 00000100:00100000:2.0:1788970540.087805:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339456 00000100:00080000:0.0:1788970540.087882:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970540.088316:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:2.0:1788970540.088329:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082339456:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788970540.088370:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788970540.088759:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082339456:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 431us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.088768:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:1.0:1788970540.094376:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2400:x1875871082339712:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 6905us (22548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970540.094414:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:3.0:1788970540.094661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970540.094817:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.095725:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339328 00000100:00100000:0.0:1788970540.095740:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339328 00000100:00100000:0.0:1788970540.095813:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082339072 00000100:00100000:0.0:1788970540.095816:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082339072 00000100:00100000:0.0:1788970540.095843:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970540.095853:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:0:x1875871082339328:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970540.095902:0:19483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970540.095985:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:0:x1875871082339328:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 132us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970540.095993:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970540.096011:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1788970540.096018:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:0:x1875871082339072:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970540.096057:0:19483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788970540.096365:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:0:x1875871082339072:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 345us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970540.096372:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00080000:1.0:1788970540.096856:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970540.109352:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970540.110765:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340096 00000100:00100000:3.0:1788970540.110787:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340096 00000100:00100000:3.0:1788970540.110884:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1788970540.110899:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082340096:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788970540.111042:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082340096:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 147us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970540.111051:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970540.131440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.131481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970540.131546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970540.131619:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340224 00000100:00100000:3.0:1788970540.131641:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340224 00000100:00100000:3.0:1788970540.131686:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340352 00000100:00100000:3.0:1788970540.131688:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340352 00000100:00100000:3.0:1788970540.131705:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970540.131715:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875871082340224:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788970540.131772:0:19710:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7365f4d7-b3e1-4126-9092-d6317f98dfcc@192.168.203.15@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1788970540.131811:0:19710:0:(genops.c:1384:class_connect()) connect: client 7365f4d7-b3e1-4126-9092-d6317f98dfcc, cookie 0xc3abfebe76c6fece 00002000:00100000:3.0:1788970540.131825:0:19710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7365f4d7-b3e1-4126-9092-d6317f98dfcc/ffff8a7d831de000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788970540.131836:0:19710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788970540.131946:0:19710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788970540.131984:0:19710:0:(import.c:65:import_set_state_nolock()) ffff8a7d831dc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970540.132055:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2399:x1875871082340224:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 340us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970540.132063:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970540.132081:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:3.0:1788970540.132086:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875871082340352:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788970540.132113:0:19710:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7365f4d7-b3e1-4126-9092-d6317f98dfcc@192.168.203.15@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1788970540.132130:0:19710:0:(genops.c:1384:class_connect()) connect: client 7365f4d7-b3e1-4126-9092-d6317f98dfcc, cookie 0xc3abfebe76c6fed5 00002000:00100000:3.0:1788970540.132135:0:19710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7365f4d7-b3e1-4126-9092-d6317f98dfcc/ffff8a7d831da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788970540.132141:0:19710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788970540.132183:0:19710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788970540.132195:0:19710:0:(import.c:65:import_set_state_nolock()) ffff8a7d831d8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970540.132227:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2399:x1875871082340352:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 140us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970540.132234:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1788970540.132559:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340480 00000100:00100000:2.0:1788970540.132565:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340480 00000100:00100000:2.0:1788970540.132603:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1788970540.132610:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082340480:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788970540.132662:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082340480:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 53us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.132669:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1788970540.141248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970540.141554:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340608 00000100:00100000:3.0:1788970540.141568:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340608 00000100:00100000:3.0:1788970540.141650:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1788970540.141664:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082340608:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788970540.141798:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788970540.142090:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15008:x1875871082340608:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 427us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970540.142110:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000040:00080000:0.0:1788970540.253188:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788970540.341287:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970540.341582:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340736 00000100:00100000:1.0:1788970540.341596:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340736 00000100:00100000:1.0:1788970540.341714:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1788970540.341736:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15045:x1875871082340736:12345-192.168.203.15@tcp:101:mkdir.0 00010000:00010000:1.0:1788970540.341768:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970540.341796:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6fedc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc1a expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970540.341890:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970540.341913:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970540.341928:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970540.341996:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788970540.342001:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970540.342027:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970540.342062:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c6fedc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 8 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970540.342110:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970540.342120:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:1.0:1788970540.342124:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970540.342128:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9be00, rc 0) 00000100:00100000:1.0:1788970540.342219:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+7:15045:x1875871082340736:12345-192.168.203.15@tcp:101:mkdir.0 Request processed in 494us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970540.342227:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:2.0:1788970540.764794:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970540.830322:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970540.830358:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102339584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970540.830490:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970540.831678:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339584 00000100:00100000:2.0:1788970540.831693:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339584 00000100:00100000:2.0:1788970540.831823:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970540.831847:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102339584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970540.831891:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970540.832114:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102339584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 272us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970540.832121:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788970540.832222:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970540.832481:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102339584:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788970541.788608:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970541.862330:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970541.862366:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102339712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970541.862509:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970541.862595:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339712 00000100:00100000:2.0:1788970541.862606:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339712 00000100:00100000:2.0:1788970541.862668:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788970541.862680:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102339712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970541.862725:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788970541.864436:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970541.864470:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102339840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970541.864554:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970541.868638:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339840 00000100:00100000:0.0:1788970541.868662:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339840 00000100:00100000:0.0:1788970541.868734:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788970541.868749:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102339840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970541.868804:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788970541.868936:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102339840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (4381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970541.868944:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788970541.871014:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102339712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8326us (8495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970541.871031:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970541.872196:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102339712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970541.872287:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102339840:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788970542.621559:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970542.818206:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788970542.879638:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000001:00100000:3.0:1788970542.879658:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:00100000:0.0:1788970542.881128:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000001:00100000:0.0:1788970542.881142:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:02000400:2.0:1788970543.184799:0:20028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788970543.402967:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102339968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970543.403068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.403151:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970543.403159:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102340096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970543.403198:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.403242:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102339968 00000100:00100000:3.0:1788970543.403251:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102339968 00000100:00100000:3.0:1788970543.403311:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340096 00000100:00100000:3.0:1788970543.403315:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340096 00000100:00100000:3.0:1788970543.403340:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970543.403350:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102339968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970543.403437:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788970543.403488:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102339968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.403496:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970543.403517:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970543.403524:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102340096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788970543.405823:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788970543.405926:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102340096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2398us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.405939:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788970543.405984:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970543.406006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102340224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970543.406050:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.406333:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102340096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970543.406348:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788970543.406373:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102339968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970543.406831:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340224 00000100:00100000:0.0:1788970543.406841:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340224 00000100:00100000:0.0:1788970543.406903:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970543.406916:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102340224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970543.406953:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788970543.407011:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102340224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970543.407018:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788970543.407460:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970543.407502:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102340224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970543.407728:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102340736:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.407773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.407802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102341248:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.407827:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.407846:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788970543.407852:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102340352:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.407897:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.407926:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102340864:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.407950:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.407970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e93590b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102341376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.407994:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.408022:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340736 00000100:00100000:3.0:1788970543.408028:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340736 00000100:00100000:3.0:1788970543.408071:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788970543.408078:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.408123:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102340736:12345-0@lo:400:kworker.0 Request processed in 45us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.408130:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788970543.408152:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102341248 00000100:00100000:3.0:1788970543.408155:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102341248 00000100:00100000:0.0:1788970543.411582:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340352 00000100:00100000:0.0:1788970543.411606:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340352 00000100:00100000:0.0:1788970543.411697:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788970543.411709:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3649:x1875871102340352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970543.411823:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3649:x1875871102340352:12345-0@lo:400:kworker.0 Request processed in 116us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970543.411848:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788970543.412361:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102341376 00000100:00100000:3.0:1788970543.412368:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102341376 00000100:00100000:3.0:1788970543.412427:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970543.412439:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102341248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412495:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102341248:12345-0@lo:400:kworker.0 Request processed in 61us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.412502:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970543.412522:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970543.412529:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102341376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412615:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102341376:12345-0@lo:400:kworker.0 Request processed in 87us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.412622:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970543.412657:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340864 00000100:00100000:3.0:1788970543.412662:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340864 00000100:00100000:3.0:1788970543.412695:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970543.412702:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102340864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412738:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102340864:12345-0@lo:400:kworker.0 Request processed in 37us (4787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.412745:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788970543.412775:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970543.412782:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970543.412784:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970543.412814:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102340608:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412854:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.412884:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102341120:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412904:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.412926:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788970543.412933:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102340480:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412955:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.412971:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102340992:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.412991:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.413007:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102341504:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.413027:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970543.413052:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340480 00000100:00100000:3.0:1788970543.413057:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340480 00000100:00100000:3.0:1788970543.413087:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788970543.413094:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102340480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.413130:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102340480:12345-0@lo:400:kworker.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.413146:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788970543.413161:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340608 00000100:00100000:3.0:1788970543.413165:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340608 00000100:00100000:3.0:1788970543.413192:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102341120 00000100:00100000:3.0:1788970543.413195:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102341120 00000100:00100000:3.0:1788970543.413215:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102340992 00000100:00100000:3.0:1788970543.413217:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102340992 00000100:00100000:3.0:1788970543.413227:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102341504 00000100:00100000:3.0:1788970543.413229:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102341504 00000100:00100000:3.0:1788970543.413245:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970543.413250:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102340608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.413299:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102340608:12345-0@lo:400:kworker.0 Request processed in 48us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.413306:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970543.413318:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788970543.413325:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102341120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.413349:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102341120:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.413354:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788970543.413367:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970543.413372:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102340992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.413423:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102340992:12345-0@lo:400:kworker.0 Request processed in 50us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.413429:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970543.413441:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970543.413447:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102341504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.413482:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102341504:12345-0@lo:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970543.413488:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788970543.413508:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970543.413511:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970543.416717:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102340352:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416762:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102340864:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416776:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93590b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102341376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102340736:0@lo:400:kworker.0 00010000:00080000:3.0:1788970543.416805:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7e93593840 x1875871102341248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970543.416817:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e93593840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102341248:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416885:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102340480:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416898:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102340992:0@lo:400:kworker.0 00010000:00080000:3.0:1788970543.416911:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ea1f2f0c0 x1875871102341504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970543.416921:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102341504:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416932:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102340608:0@lo:400:kworker.0 00000100:00100000:3.0:1788970543.416943:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102341120:0@lo:400:kworker.0 00010000:00010000:2.0:1788970543.845278:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970544.861647:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970545.351684:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970545.351927:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340864 00000100:00100000:2.0:1788970545.351943:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340864 00000100:00100000:0.0:1788970545.351980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970545.352010:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:0.0:1788970545.352012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970545.352022:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2403:x1875871082340864:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970545.352042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970545.352067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970545.352131:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2403:x1875871082340864:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970545.352140:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:2.0:1788970545.352197:0:19264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341376 00000100:00100000:2.0:1788970545.352210:0:19264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341376 00000100:00100000:2.0:1788970545.352262:0:19264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341888 00000100:00100000:2.0:1788970545.352265:0:19264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341888 00000100:00100000:2.0:1788970545.352290:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1788970545.352297:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082341376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970545.353598:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341120 00000100:00100000:1.0:1788970545.353613:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341120 00000100:00100000:1.0:1788970545.353673:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341632 00000100:00100000:1.0:1788970545.353677:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341632 00000100:00100000:1.0:1788970545.353711:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:1.0:1788970545.353721:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082341120:12345-192.168.203.15@tcp:400:kworker.0 00000100:00080000:3.0:1788970545.354434:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970545.354443:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970545.354482:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1788970545.354877:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2403:x1875871082341632:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970545.359883:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082341376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 7568us (7851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970545.359903:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1788970545.359954:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970545.359972:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2403:x1875871082341888:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970545.361686:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082341120:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 7953us (9692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970545.361727:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2403:x1875871082341632:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 7230us (9688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970545.361744:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:1.0:1788970545.361914:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:3.0:1788970545.363214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970545.363256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970545.363280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970545.363306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970545.363337:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341248 00000100:00100000:3.0:1788970545.363350:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341248 00000100:00100000:3.0:1788970545.363430:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341760 00000100:00100000:3.0:1788970545.363433:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341760 00000100:00100000:3.0:1788970545.363452:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:3.0:1788970545.363462:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082341248:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970545.363534:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082341248:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970545.363542:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:3.0:1788970545.363569:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1788970545.363785:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e93590b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2403:x1875871082341760:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970545.363815:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e93590b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2403:x1875871082341760:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 239us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970545.363822:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1788970545.363844:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082340992 00000100:00100000:3.0:1788970545.363848:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082340992 00000100:00100000:3.0:1788970545.363879:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082341504 00000100:00100000:3.0:1788970545.363895:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082341504 00000100:00100000:3.0:1788970545.363916:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:3.0:1788970545.363922:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2403:x1875871082340992:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970545.363952:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2403:x1875871082340992:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970545.363959:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:3.0:1788970545.363973:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:3.0:1788970545.363979:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e93593840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2403:x1875871082341504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:3.0:1788970545.364003:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e93593840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2403:x1875871082341504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970545.364008:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00080000:3.0:1788970545.364031:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970545.364037:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970545.369543:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2403:x1875871082341888:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 9564us (17458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970545.369571:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000001:00100000:2.0:1788970545.444570:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000001:00100000:1.0:1788970545.444896:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00010000:00010000:0.0:1788970545.886573:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970545.964570:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102341632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970545.964681:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970545.965051:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102341632 00000100:00100000:2.0:1788970545.965072:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102341632 00000100:00100000:2.0:1788970545.965149:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970545.965172:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102341632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970545.965214:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970545.965285:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102341632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970545.965293:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788970545.965437:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970545.965493:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102341632:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1788970546.492338:0:20175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd484e78c0 20000000:00000080:2.0:1788970546.492357:0:20175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7e8ebc2400 uarg=0000000000000000 20000000:01000000:2.0:1788970546.492446:0:20175:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788970546.492453:0:20175:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788970546.492463:0:20175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788970546.496327:0:20176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788970546.496687:0:20175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788970546.512784:0:20175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788970546.512822:0:20175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512860:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512869:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512877:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512884:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512894:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512902:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.512930:0:20175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.513086:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.513117:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 12 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.513133:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102341760:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970546.513280:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.513289:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.513314:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102341888:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970546.513347:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.513357:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 23 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.513367:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342016:0@lo:104: 00000100:00100000:1.0:1788970546.513435:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970546.513492:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.513502:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 23 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.513511:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342144:0@lo:104: 00000100:00100000:1.0:1788970546.513534:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970546.514210:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.514293:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 23 pid: 17144 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.514305:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342272:0@lo:104: 00000100:00100000:1.0:1788970546.514775:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970546.520082:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970546.520103:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 23 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.520120:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342400:0@lo:104: 00000100:00100000:1.0:1788970546.520182:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970546.520694:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342016 00000100:00100000:2.0:1788970546.520705:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342016 00000100:00100000:2.0:1788970546.520752:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342144 00000100:00100000:2.0:1788970546.520755:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342144 00000100:00100000:2.0:1788970546.520766:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342272 00000100:00100000:2.0:1788970546.520769:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342272 00000100:00100000:2.0:1788970546.520781:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970546.520789:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+5:20175:x1875871102342016:12345-0@lo:104: 00010000:00010000:2.0:1788970546.520802:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.520872:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970546.520877:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+5:20175:x1875871102342016:12345-0@lo:104: Request processed in 89us (7444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970546.520884:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970546.520899:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970546.520904:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+4:20175:x1875871102342144:12345-0@lo:104: 00010000:00010000:2.0:1788970546.520911:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.520972:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788970546.520977:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+4:20175:x1875871102342144:12345-0@lo:104: Request processed in 73us (7444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970546.520983:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970546.520996:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970546.521002:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:20175:x1875871102342272:12345-0@lo:104: 00010000:00010000:2.0:1788970546.521009:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521057:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788970546.521062:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:20175:x1875871102342272:12345-0@lo:104: Request processed in 61us (6289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970546.521080:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788970546.521098:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788970546.521103:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521110:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970546.521114:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521122:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970546.521130:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970546.521137:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970546.521148:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970546.521153:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521168:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970546.521171:0:19487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521176:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521182:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970546.521186:0:19487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970546.521200:0:19487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521202:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970546.521206:0:19487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970546.521209:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013600/0xc3abfebe76c6fc5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fc66 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521220:0:19487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521225:0:19487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970546.521231:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521234:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970546.521238:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654e00/0xc3abfebe76c6fbc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fbcc expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521238:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521244:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eae013000 already unused, calling callback (ffffffffc116cc20) 00010000:00010000:3.0:1788970546.521247:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788970546.521247:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521249:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970546.521251:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970546.521254:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970546.521260:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970546.521265:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788970546.521271:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102342528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970546.521280:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521285:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970546.521298:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.521305:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013000/0xc3abfebe76c6fb86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb8d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970546.521314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970546.521314:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970546.521315:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970546.521317:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970546.521356:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970546.521363:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102342656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970546.521594:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970546.521630:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102342784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970546.521654:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970546.521684:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342528 00000100:00100000:3.0:1788970546.521689:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342528 00010000:00010000:3.0:1788970546.521711:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 24 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970546.521739:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342656 00000100:00100000:3.0:1788970546.521742:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342656 00010000:00010000:3.0:1788970546.521754:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 25 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970546.521763:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342784 00000100:00100000:3.0:1788970546.521765:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342784 00010000:00010000:3.0:1788970546.521774:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 26 pid: 17144 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970546.521786:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970546.521792:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+26:3649:x1875871102342528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970546.521803:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970546.521808:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 26 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521816:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 26 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521833:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970546.521862:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+26:3649:x1875871102342528:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970546.521869:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970546.521884:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970546.521890:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+25:3649:x1875871102342656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970546.521898:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970546.521903:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 25 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521921:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 25 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.521931:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970546.521955:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+25:3649:x1875871102342656:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970546.521961:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970546.521975:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970546.521981:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102342784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970546.521989:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970546.521992:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 24 pid: 17144 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.522000:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 24 pid: 17144 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.522009:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970546.522033:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102342784:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970546.522039:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970546.522074:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102342784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970546.522102:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102342656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970546.522109:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102342528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970546.523081:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970546.523999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970546.524099:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342016 00000100:00100000:3.0:1788970546.524108:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342016 00000100:00100000:1.0:1788970546.524656:0:20175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591840 going to sleep for 11 seconds 00010000:00010000:3.0:1788970546.524669:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 13 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.524682:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102341760:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970546.524691:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102341888:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970546.524701:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c6fc66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fc5f expref: 23 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.524713:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342016:0@lo:104: 00000100:00100000:3.0:1788970546.524715:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00010000:00010000:1.0:1788970546.524722:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae013200/0xc3abfebe76c6fbcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fbc5 expref: 22 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970546.524725:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2402:x1875871082342016:12345-192.168.203.15@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788970546.524731:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342144:0@lo:104: 00010000:00010000:3.0:1788970546.524737:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970546.524740:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012600/0xc3abfebe76c6fb8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fb86 expref: 21 pid: 17144 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.524743:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 13 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.524753:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 13 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970546.524762:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342272:0@lo:104: 00010000:00010000:3.0:1788970546.524769:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c6feb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe9 expref: 13 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.524780:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970546.524831:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:2402:x1875871082342016:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 108us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970546.524839:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1788970546.525195:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342400 00000100:00100000:2.0:1788970546.525208:0:17134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342400 00000100:00100000:2.0:1788970546.525280:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970546.525288:0:17134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:20175:x1875871102342400:12345-0@lo:104: 00010000:00010000:2.0:1788970546.525300:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.525433:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970546.525440:0:17134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c12dceb-6b52-416d-b090-7691eb149d35+3:20175:x1875871102342400:12345-0@lo:104: Request processed in 153us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970546.525449:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788970546.525470:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970546.525478:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.525487:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970546.525492:0:19487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.525502:0:19487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970546.525520:0:19487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970546.525526:0:19487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970546.525572:0:19487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.525578:0:19487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970546.525600:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.525608:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654600/0xc3abfebe76c6fb78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c6fb7f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970546.525705:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970546.525709:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970546.525711:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1875871102342400:0@lo:104: 00010000:00010000:3.0:1788970546.525712:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970546.525733:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102342912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970546.525754:0:20175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970546.525781:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970546.526067:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102342912 00000100:00100000:3.0:1788970546.526127:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970546.526144:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102342912 00010000:00010000:0.0:1788970546.526179:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 21 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970546.526246:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342144 00000100:00100000:0.0:1788970546.526251:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342144 00010000:00010000:0.0:1788970546.526266:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970546.529855:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970546.529881:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83231450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+21:3652:x1875871102342912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970546.529902:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970546.529911:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 21 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.529924:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 21 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.529942:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012200/0xc3abfebe76c6fb7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c6fb78 expref: 21 pid: 17145 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.529960:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970546.530052:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83231450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+20:3652:x1875871102342912:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970546.530085:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970546.530139:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970546.530147:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:2403:x1875871082342144:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970546.530169:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970546.530179:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530189:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530200:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c6fe7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db79 expref: 12 pid: 17143 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530210:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530218:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970546.530219:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102342912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970546.530232:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530239:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530245:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530251:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530264:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970546.530268:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530277:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530303:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970546.530315:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970546.530355:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:2403:x1875871082342144:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 209us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970546.530362:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00010000:00010000:2.0:1788970546.530511:0:20175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.530520:0:20175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.530526:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83025600/0xc3abfebe76c6feea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970546.908549:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970546.974850:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970546.974871:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102343040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970546.974937:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970546.975324:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343040 00000100:00100000:3.0:1788970546.975334:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343040 00000100:00100000:3.0:1788970546.975417:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788970546.975428:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102343040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970546.975461:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788970546.975524:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102343040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970546.975531:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788970546.975587:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102343040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970546.979475:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102343168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970546.979569:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970546.979668:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343168 00000100:00100000:0.0:1788970546.979677:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343168 00000100:00100000:0.0:1788970546.979730:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970546.979739:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102343168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970546.979775:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970546.990629:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102343168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10882us (11051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970546.990643:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970546.990966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102343168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970547.933689:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788970548.380995:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970548.381003:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7eb0ea2800 from 13 10000000:01000000:3.0:1788970548.381009:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970548.381056:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.381067:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.381078:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970548.381103:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970548.381184:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.381231:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e883ddb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970548.381289:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343296 00000100:00100000:0.0:1788970548.381297:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343296 00000100:00100000:0.0:1788970548.381365:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788970548.381375:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+20:17147:x1875871102343296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970548.381417:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970548.381562:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c6fef8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6fef1 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.381587:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c6fef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6fef1 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.381598:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c6fef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6fef1 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.381606:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024200, rc 0) 00000100:00100000:0.0:1788970548.381644:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102343296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.381651:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788970548.381818:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970548.381834:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.381843:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970548.381988:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970548.382020:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.382047:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e883ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970548.382101:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343424 00000100:00100000:2.0:1788970548.382105:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343424 00000100:00100000:2.0:1788970548.382139:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788970548.382156:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102343424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.382267:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102343424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.382274:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788970548.383029:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.383074:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.383125:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.383160:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970548.383217:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343552 00000100:00100000:2.0:1788970548.383222:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343552 00000100:00100000:2.0:1788970548.383262:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788970548.383269:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102343552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.383364:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102343552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.383371:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788970548.384069:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788970548.388617:0:20248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788970548.389218:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788970548.389266:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970548.389279:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.389302:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970548.389331:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970548.389334:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81acf000 from 13 10000000:01000000:0.0:1788970548.389337:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970548.389374:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.389403:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.389416:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970548.389445:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.389515:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.389554:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970548.389677:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343680 00000100:00100000:3.0:1788970548.389685:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343680 00000100:00100000:3.0:1788970548.389724:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788970548.389734:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+21:17147:x1875871102343680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970548.389747:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970548.389760:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6ff06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6feff expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.389784:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6ff06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6feff expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.389795:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6ff06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6feff expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.389803:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3e00, rc 0) 00000100:00100000:3.0:1788970548.389850:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102343680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.389857:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788970548.392132:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970548.392177:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.392191:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970548.392288:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.392353:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.392547:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970548.392611:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343808 00000100:00100000:0.0:1788970548.392618:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343808 00000100:00100000:0.0:1788970548.392667:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970548.392676:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102343808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.392806:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102343808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.392815:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970548.392862:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.392891:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.392929:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.392956:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970548.397284:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102343936 00000100:00100000:2.0:1788970548.397302:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102343936 00000100:00100000:2.0:1788970548.397367:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788970548.397377:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102343936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.397583:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102343936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.397591:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788970548.397660:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102343936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788970548.398315:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788970548.398374:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788970548.398438:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970548.398448:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970548.398460:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970548.398471:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970548.398474:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebf423000 from 13 10000000:01000000:2.0:1788970548.398476:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970548.398507:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970548.398524:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970548.398535:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970548.398556:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.398598:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970548.398630:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970548.399189:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344064 00000100:00100000:0.0:1788970548.399196:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344064 00000100:00100000:0.0:1788970548.399241:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788970548.399250:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+22:17147:x1875871102344064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970548.399262:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970548.399277:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c6ff14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6ff0d expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.399303:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c6ff14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6ff0d expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.399314:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c6ff14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6ff0d expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.399322:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024c00, rc 0) 00000100:00100000:0.0:1788970548.399369:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102344064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.399376:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788970548.399451:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970548.399466:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.399477:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970548.399543:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.399574:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.399590:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88297780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970548.399603:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344192 00000100:00100000:0.0:1788970548.399606:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344192 00000100:00100000:0.0:1788970548.399631:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788970548.399639:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102344192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.399812:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102344192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.399820:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788970548.399855:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970548.406118:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970548.406220:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970548.406267:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970548.406623:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344320 00000100:00100000:2.0:1788970548.406632:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344320 00000100:00100000:2.0:1788970548.407501:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788970548.407517:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb5a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102344320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.407660:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb5a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102344320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.407668:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788970548.407778:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970548.417978:0:20251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788970548.418505:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788970548.418561:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970548.418573:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970548.418585:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970548.418778:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970548.418782:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7e92fc7000 from 13 10000000:01000000:1.0:1788970548.418785:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970548.418825:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970548.418834:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970548.418845:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970548.418886:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970548.418953:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970548.418998:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970548.419048:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344448 00000100:00100000:0.0:1788970548.419066:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344448 00000100:00100000:0.0:1788970548.419111:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788970548.419119:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+23:17147:x1875871102344448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970548.419132:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970548.419154:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83025400/0xc3abfebe76c6ff22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c6ff1b expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.419185:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025400/0xc3abfebe76c6ff22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c6ff1b expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.419195:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83025400/0xc3abfebe76c6ff22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c6ff1b expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.419204:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025400, rc 0) 00000100:00100000:0.0:1788970548.419251:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102344448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.419258:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788970548.420955:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970548.420981:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970548.420994:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970548.421078:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.421130:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.421177:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344576 00000100:00100000:2.0:1788970548.421183:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970548.421185:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344576 00000100:00100000:0.0:1788970548.422157:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788970548.422174:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102344576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.422309:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102344576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.422317:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788970548.422440:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.422487:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.422542:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970548.429604:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344704 00000100:00100000:0.0:1788970548.429619:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344704 00000100:00100000:0.0:1788970548.429672:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788970548.429681:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102344704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970548.429824:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:17147:x1875871102344704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (7280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.429831:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788970548.432400:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970548.432566:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342272 00000100:00100000:0.0:1788970548.432575:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342272 00000100:00100000:0.0:1788970548.432648:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:0.0:1788970548.432659:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:14895:x1875871082342272:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970548.432679:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970548.432698:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c6ff29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc21 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.432727:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c6ff29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc21 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.432739:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c6ff29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc21 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970548.432748:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025200, rc 0) 00000100:00100000:0.0:1788970548.432813:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:14895:x1875871082342272:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 156us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970548.432820:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 158 00000100:00100000:2.0:1788970548.438338:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970548.438406:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c12dceb-6b52-416d-b090-7691eb149d35:17147:1875871102344704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788970548.441000:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:2.0:1788970548.441217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970548.441622:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342400 00000100:00100000:3.0:1788970548.441633:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342400 00000100:00100000:3.0:1788970548.441688:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 159 00000100:00100000:3.0:1788970548.441699:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:14895:x1875871082342400:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970548.441881:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:14895:x1875871082342400:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 183us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.441889:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 159 00000020:01000000:1.0:1788970548.442866:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788970548.442893:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970548.443114:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970548.443127:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970548.454017:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970548.457104:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342528 00000100:00100000:2.0:1788970548.457120:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342528 00000100:00100000:2.0:1788970548.457193:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:2.0:1788970548.457203:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:14895:x1875871082342528:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970548.457658:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:14895:x1875871082342528:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 455us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.457667:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 160 00000100:00100000:1.0:1788970548.471795:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970548.472039:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342656 00000100:00100000:3.0:1788970548.472050:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342656 00000100:00100000:3.0:1788970548.472099:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:3.0:1788970548.472109:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:14895:x1875871082342656:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970548.472126:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970548.472153:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df3400/0xc3abfebe76c6ff30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc28 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.472184:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df3400/0xc3abfebe76c6ff30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc28 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.472196:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df3400/0xc3abfebe76c6ff30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc28 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970548.472206:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3400, rc 0) 00000100:00100000:3.0:1788970548.472268:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:14895:x1875871082342656:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 161us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.472275:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 161 00000100:00100000:0.0:1788970548.480628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970548.480696:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342784 00000100:00100000:3.0:1788970548.480706:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342784 00000100:00100000:3.0:1788970548.480768:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:3.0:1788970548.480777:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:14895:x1875871082342784:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970548.480919:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:14895:x1875871082342784:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 143us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.480935:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:1.0:1788970548.485267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970548.485411:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082342912 00000100:00100000:3.0:1788970548.485421:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082342912 00000100:00100000:3.0:1788970548.485481:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:3.0:1788970548.485492:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:14895:x1875871082342912:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970548.485626:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:14895:x1875871082342912:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 135us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.485634:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 163 00000100:00100000:3.0:1788970548.509705:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102344832:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.509769:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.509802:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102345344:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.509823:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.509839:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102345856:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.509857:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.509878:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788970548.509884:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83edb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102344960:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.509906:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.509923:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102345472:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.509941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.509958:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102345984:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.509976:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102345088:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510020:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510060:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102345600:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510082:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510097:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102346112:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510135:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510166:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788970548.510172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102345216:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510195:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510211:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102345728:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510227:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510236:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102346240:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510251:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970548.510277:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344832 00000100:00100000:3.0:1788970548.510284:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344832 00000100:00100000:3.0:1788970548.510324:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345344 00000100:00100000:3.0:1788970548.510328:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345344 00000100:00100000:3.0:1788970548.510345:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788970548.510354:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102344832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510436:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102344832:12345-0@lo:400:kworker.0 Request processed in 82us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510442:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788970548.510459:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970548.510465:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510493:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102345344:12345-0@lo:400:kworker.0 Request processed in 28us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510499:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970548.510519:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345856 00000100:00100000:3.0:1788970548.510529:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345856 00000100:00100000:3.0:1788970548.510559:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345984 00000100:00100000:3.0:1788970548.510562:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345984 00000100:00100000:3.0:1788970548.510574:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102346112 00000100:00100000:3.0:1788970548.510576:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102346112 00000100:00100000:3.0:1788970548.510588:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345216 00000100:00100000:3.0:1788970548.510590:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345216 00000100:00100000:3.0:1788970548.510600:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345728 00000100:00100000:3.0:1788970548.510602:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345728 00000100:00100000:3.0:1788970548.510612:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102346240 00000100:00100000:3.0:1788970548.510614:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102346240 00000100:00100000:3.0:1788970548.510627:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970548.510632:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102345856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510663:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102345856:12345-0@lo:400:kworker.0 Request processed in 30us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510669:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970548.510681:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788970548.510687:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102345984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510712:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102345984:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510717:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788970548.510726:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970548.510732:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102346112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510760:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875871102346112:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510766:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788970548.510778:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788970548.510783:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102345216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510816:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102345216:12345-0@lo:400:kworker.0 Request processed in 33us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510822:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788970548.510834:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788970548.510840:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102345728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510878:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102345728:12345-0@lo:400:kworker.0 Request processed in 38us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510885:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788970548.510896:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788970548.510902:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102346240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.510928:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102346240:12345-0@lo:400:kworker.0 Request processed in 27us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.510933:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788970548.510951:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102344960 00000100:00100000:3.0:1788970548.510955:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102344960 00000100:00100000:3.0:1788970548.510980:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345472 00000100:00100000:3.0:1788970548.510983:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345472 00000100:00100000:3.0:1788970548.510993:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345088 00000100:00100000:3.0:1788970548.510995:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345088 00000100:00100000:3.0:1788970548.511004:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102345600 00000100:00100000:3.0:1788970548.511006:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102345600 00000100:00100000:3.0:1788970548.511017:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970548.511022:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102344960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511047:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102344960:12345-0@lo:400:kworker.0 Request processed in 26us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.511052:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970548.511062:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970548.511075:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102345472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511102:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102345472:12345-0@lo:400:kworker.0 Request processed in 29us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.511108:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970548.511118:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970548.511124:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102345088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511160:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102345088:12345-0@lo:400:kworker.0 Request processed in 37us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.511166:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970548.511176:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970548.511181:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102345600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511217:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102345600:12345-0@lo:400:kworker.0 Request processed in 36us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970548.511223:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788970548.511264:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970548.511268:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970548.511271:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970548.511273:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970548.511302:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102345216:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102345728:0@lo:400:kworker.0 00010000:00080000:3.0:1788970548.511325:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d830e8780 x1875871102346240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970548.511335:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102346240:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511344:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102345088:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102345600:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875871102346112:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511434:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102344960:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511443:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102345472:0@lo:400:kworker.0 00010000:00080000:3.0:1788970548.511453:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d830ea580 x1875871102345984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970548.511461:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102345984:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511470:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102344832:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511478:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102345344:0@lo:400:kworker.0 00000100:00100000:3.0:1788970548.511487:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102345856:0@lo:400:kworker.0 00000100:00100000:2.0:1788970548.512078:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1ea6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102346496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970548.512116:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970548.512164:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970548.512170:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102346368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970548.512190:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970548.512222:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102346496 00000100:00100000:2.0:1788970548.512226:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102346496 00000100:00100000:2.0:1788970548.512249:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102346368 00000100:00100000:2.0:1788970548.512252:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102346368 00000100:00100000:2.0:1788970548.512264:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788970548.512271:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102346496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970548.512293:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970548.512340:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102346496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.512347:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788970548.512360:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970548.512365:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102346368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970548.512409:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788970548.512435:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102346368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.512441:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788970548.512484:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102346368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970548.512495:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1ea6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102346496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970548.512623:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970548.512634:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102346624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970548.512661:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970548.512825:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102346624 00000100:00100000:2.0:1788970548.512830:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102346624 00000100:00100000:2.0:1788970548.512859:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970548.512866:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102346624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970548.512875:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788970548.512911:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102346624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970548.512917:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788970548.512980:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102346624:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788970548.958719:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970549.984777:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970550.051574:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.051763:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343040 00000100:00100000:3.0:1788970550.051774:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343040 00000100:00100000:3.0:1788970550.051853:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:3.0:1788970550.051864:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:15561:x1875871082343040:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970550.051883:0:19483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.051907:0:19483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc2f expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.051972:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.051986:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052018:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052048:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052056:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052063:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052150:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8000/0xc3abfebe76c6ff4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052159:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8000/0xc3abfebe76c6ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052167:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8000/0xc3abfebe76c6ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970550.052203:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788970550.052207:0:19483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970550.052243:0:19483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8000/0xc3abfebe76c6ff4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052254:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052260:0:19483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052276:0:19483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052282:0:19483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.052286:0:19483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052294:0:19483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052306:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:3.0:1788970550.052309:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.052314:0:19483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052320:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052333:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052339:0:19483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052345:0:19483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052350:0:19483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.052353:0:19483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052369:0:19483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052377:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a7eb0e83b00) 00010000:00010000:3.0:1788970550.052578:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.052582:0:19483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052589:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052621:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc2f expref: 8 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052634:0:19483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8000/0xc3abfebe76c6ff4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc2f expref: 7 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.052642:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7eb0e83800) 00010000:00010000:3.0:1788970550.052644:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970550.052646:0:19483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8000, rc 0) 00000100:00100000:3.0:1788970550.052703:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:15561:x1875871082343040:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 842us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970550.052710:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00080000:0.0:1788970550.052773:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970550.058942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.059029:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343168 00000100:00100000:2.0:1788970550.059048:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343168 00000100:00100000:2.0:1788970550.059102:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:2.0:1788970550.059113:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:15561:x1875871082343168:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788970550.059205:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:15561:x1875871082343168:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970550.059226:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1788970550.062407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.062480:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343424 00000100:00100000:3.0:1788970550.062489:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343424 00000100:00100000:3.0:1788970550.062553:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1788970550.062561:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:15561:x1875871082343424:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970550.062596:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.062616:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc36 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062694:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062708:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062719:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062770:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062777:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062783:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062873:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062880:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.062887:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970550.062896:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788970550.063042:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063050:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063057:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063062:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.063066:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063074:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063085:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7eb0e83800) 00010000:00010000:3.0:1788970550.063087:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.063091:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063097:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063110:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063116:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063122:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063145:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.063148:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063154:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063162:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a7eb0e83b00) 00010000:00010000:3.0:1788970550.063164:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.063167:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.063172:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.065113:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc36 expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.065155:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc36 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.065166:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7eb0e83300) 00010000:00010000:3.0:1788970550.065170:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.065173:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2800, rc 0) 00000100:00100000:3.0:1788970550.065316:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15561:x1875871082343424:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2754us (2940us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788970550.065325:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1788970550.085217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.085525:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343552 00000100:00100000:3.0:1788970550.085548:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343552 00000100:00100000:3.0:1788970550.085614:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:3.0:1788970550.085625:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15561:x1875871082343552:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788970550.085744:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15561:x1875871082343552:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 120us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970550.085752:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970550.092270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.092914:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343680 00000100:00100000:3.0:1788970550.092925:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343680 00000100:00100000:3.0:1788970550.093005:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00080000:0.0:1788970550.093009:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970550.093019:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:15561:x1875871082343680:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788970550.096949:0:17152:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3887us 00000100:00100000:0.0:1788970550.120478:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:15561:x1875871082343680:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 27455us (28212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.120493:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:1.0:1788970550.146113:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.146205:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343808 00000100:00100000:3.0:1788970550.146218:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343808 00000100:00100000:3.0:1788970550.146284:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:3.0:1788970550.146296:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15567:x1875871082343808:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970550.146320:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.146343:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc3d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146442:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146457:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146469:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146507:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146516:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146523:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146567:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146575:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146582:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146588:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.146593:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146601:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146613:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:3.0:1788970550.146617:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.146623:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146630:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146650:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146661:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146667:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146672:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.146675:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146681:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146690:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a7eb0e83b00) 00010000:00010000:3.0:1788970550.146692:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.146695:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.146701:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.147156:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc3d expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.147169:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:3.0:1788970550.147171:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.147183:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ff76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc3d expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.147195:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3000, rc 0) 00000100:00100000:3.0:1788970550.147297:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15567:x1875871082343808:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1003us (1194us total) trans 0 rc 301/301 00000100:00100000:3.0:1788970550.147305:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1788970550.157109:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.157306:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082343936 00000100:00100000:0.0:1788970550.157316:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082343936 00000100:00100000:0.0:1788970550.157366:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970550.157376:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15567:x1875871082343936:12345-192.168.203.15@tcp:700:lfs.0 00000100:00100000:0.0:1788970550.157503:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15567:x1875871082343936:12345-192.168.203.15@tcp:700:lfs.0 Request processed in 128us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.157511:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970550.161320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970550.161407:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082344192 00000100:00100000:1.0:1788970550.161418:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082344192 00000100:00100000:1.0:1788970550.161829:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:1.0:1788970550.161841:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:15567:x1875871082344192:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:1.0:1788970550.161905:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970550.161936:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c6fea4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbaa expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.161957:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:1.0:1788970550.161963:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970550.162035:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.162052:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 5 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.162061:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.162098:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 5 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.162114:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 5 pid: 17152 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970550.162140:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875871102346752:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970550.162273:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591540 going to sleep for 11 seconds 00000100:00100000:1.0:1788970550.176420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.176491:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e898fc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875871102346752:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970550.176521:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970550.176572:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082344320 00000100:00100000:0.0:1788970550.176580:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082344320 00000100:00080000:3.0:1788970550.176635:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788970550.176638:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 6 pid: 17152 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970550.177017:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970550.177106:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2402:x1875871082344320:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970550.177125:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970550.177145:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 6 pid: 17152 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.177157:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 6 pid: 17152 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.177181:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c6fee3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc1a expref: 6 pid: 17152 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.177199:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:0.0:1788970550.177204:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.177214:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.177240:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.177272:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970550.177329:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.177338:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970550.177340:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2402:x1875871082344320:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 315us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.177348:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00010000:00010000:3.0:1788970550.177363:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.177373:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.177412:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180339:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180362:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180482:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970550.180503:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003affe58d reply state 000000003d7c0c22 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180515:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180523:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:3.0:1788970550.180526:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970550.180529:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788970550.180535:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788970550.180543:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180550:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180556:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180563:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.180567:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180575:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180584:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4b00) 00010000:00010000:3.0:1788970550.180586:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.180597:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180604:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c6ff8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970550.180625:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003affe58d reply state 000000003d7c0c22 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180634:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.180640:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a7eb0e83b00) 00010000:00010000:3.0:1788970550.180643:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970550.180645:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788970550.180884:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+10:15567:x1875871082344192:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 19041us (19568us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788970550.180893:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:1.0:1788970550.270170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.270450:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082344448 00000100:00100000:0.0:1788970550.270461:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082344448 00000100:00100000:0.0:1788970550.270529:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:0.0:1788970550.270540:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+10:15575:x1875871082344448:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:0.0:1788970550.270564:0:19483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970550.270588:0:19483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc44 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.270646:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025a00/0xc3abfebe76c6ffa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.270659:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025a00/0xc3abfebe76c6ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.270671:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025a00/0xc3abfebe76c6ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970550.270720:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970550.270724:0:19483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970550.270765:0:19483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025a00/0xc3abfebe76c6ffa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.270810:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc44 expref: 12 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.270828:0:19483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025a00/0xc3abfebe76c6ffa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc44 expref: 11 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.271152:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:0.0:1788970550.271155:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970550.271159:0:19483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025a00, rc 0) 00000100:00100000:0.0:1788970550.271236:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+11:15575:x1875871082344448:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 698us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.271243:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1788970550.327475:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.327580:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082344576 00000100:00100000:0.0:1788970550.327591:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082344576 00000100:00100000:0.0:1788970550.327839:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:0.0:1788970550.327851:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:15576:x1875871082344576:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970550.327871:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970550.327891:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc4b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.327958:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025e00/0xc3abfebe76c6ffb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.327972:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025e00/0xc3abfebe76c6ffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.327983:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025e00/0xc3abfebe76c6ffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970550.328055:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970550.328059:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970550.328084:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025e00/0xc3abfebe76c6ffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.328111:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc4b expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.328147:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025e00/0xc3abfebe76c6ffb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc4b expref: 6 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.328157:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:0.0:1788970550.328160:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970550.328164:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025e00, rc 0) 00000100:00100000:0.0:1788970550.329360:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15576:x1875871082344576:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1501us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.329371:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:1.0:1788970550.352477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.352581:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082344704 00000100:00100000:3.0:1788970550.352592:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082344704 00000100:00100000:3.0:1788970550.352651:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:3.0:1788970550.352662:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:15576:x1875871082344704:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970550.352682:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.352702:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ffbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc52 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352767:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352784:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352820:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352834:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352841:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352849:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352916:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5400/0xc3abfebe76c6ffd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352924:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5400/0xc3abfebe76c6ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.352930:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5400/0xc3abfebe76c6ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970550.352981:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788970550.352985:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970550.353004:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5400/0xc3abfebe76c6ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353016:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353022:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353050:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353056:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.353060:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353339:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353353:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:3.0:1788970550.353356:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.353361:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353368:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c6ffc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353484:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353492:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353498:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353503:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.353506:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353525:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353535:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a7eb0e83b00) 00010000:00010000:3.0:1788970550.353537:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.353540:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353546:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353575:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3000/0xc3abfebe76c6ffbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc52 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353589:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5400/0xc3abfebe76c6ffd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc52 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.353596:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:3.0:1788970550.353598:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970550.353600:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5400, rc 0) 00000100:00100000:3.0:1788970550.353673:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+7:15576:x1875871082344704:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1012us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970550.353681:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:1.0:1788970550.366116:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.366435:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082344832 00000100:00100000:2.0:1788970550.366446:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082344832 00000100:00100000:2.0:1788970550.366523:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:2.0:1788970550.366533:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:15576:x1875871082344832:12345-192.168.203.15@tcp:900:lfs.0 00000100:00100000:2.0:1788970550.366617:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:15576:x1875871082344832:12345-192.168.203.15@tcp:900:lfs.0 Request processed in 85us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970550.366624:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00080000:3.0:1788970550.366858:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970550.372258:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.372348:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082345088 00000100:00100000:3.0:1788970550.372359:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082345088 00000100:00100000:3.0:1788970550.372515:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:3.0:1788970550.372528:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+7:15576:x1875871082345088:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:3.0:1788970550.372563:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.372585:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc59 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970550.372685:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788970550.372781:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc59 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.372794:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:3.0:1788970550.372797:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970550.372802:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c6ffd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc59 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.372819:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4c00, rc 0) 00000100:00100000:3.0:1788970550.372901:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+8:15576:x1875871082345088:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 377us (652us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788970550.372907:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:1.0:1788970550.381262:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.381338:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082345344 00000100:00100000:0.0:1788970550.381348:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082345344 00000100:00100000:0.0:1788970550.381429:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1788970550.381440:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+8:15576:x1875871082345344:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:0.0:1788970550.381498:0:19483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970550.381523:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5400/0xc3abfebe76c6ffd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc52 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.381921:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:0.0:1788970550.381935:0:19483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970550.381959:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.381975:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.381985:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970550.382203:0:19483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c50a5944 reply state 000000003dcd2fe9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.382216:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.382223:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:0.0:1788970550.382225:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788970550.382228:0:19483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788970550.382234:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788970550.382323:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7365f4d7-b3e1-4126-9092-d6317f98dfcc+9:15576:x1875871082345344:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 883us (1068us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788970550.382330:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:2.0:1788970550.385155:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.385242:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082345600 00000100:00100000:3.0:1788970550.385253:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082345600 00000100:00100000:3.0:1788970550.385308:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970550.385317:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+9:15576:x1875871082345600:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970550.385543:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+10:15576:x1875871082345600:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 226us (395us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788970550.385550:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:2.0:1788970550.397552:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.399492:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082345856 00000100:00100000:0.0:1788970550.399506:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082345856 00000100:00100000:0.0:1788970550.399575:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:0.0:1788970550.399586:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+10:15576:x1875871082345856:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970550.399612:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970550.399634:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c6ffed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc60 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399724:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399737:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399748:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399759:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399766:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399773:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970550.399880:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788970550.399946:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399954:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399960:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399965:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970550.399971:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399987:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.399999:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:0.0:1788970550.400002:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970550.400007:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400013:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c6fff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400038:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400045:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400050:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400054:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970550.400057:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400062:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400068:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a7eb0e83b00) 00010000:00010000:0.0:1788970550.400071:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970550.400073:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.400090:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c6fffb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.401601:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c6ffed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc60 expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.401619:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:0.0:1788970550.401622:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970550.401626:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c6ffed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc60 expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970550.401642:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024600, rc 0) 00000100:00100000:0.0:1788970550.402206:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+11:15576:x1875871082345856:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2617us (4658us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788970550.402216:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:0.0:1788970550.409815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.411723:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082345984 00000100:00100000:3.0:1788970550.411736:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082345984 00000100:00100000:2.0:1788970550.412003:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:2.0:1788970550.412015:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+11:15576:x1875871082345984:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970550.412040:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970550.412063:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70009 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc67 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.412189:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.412205:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.412216:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970550.412270:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970550.412274:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970550.412294:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.412322:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70009 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.412341:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.412350:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:2.0:1788970550.412354:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970550.412357:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654600, rc 0) 00000100:00100000:2.0:1788970550.412565:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+12:15576:x1875871082345984:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 551us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970550.412572:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:2.0:1788970550.420602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.420690:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082346112 00000100:00100000:3.0:1788970550.420714:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082346112 00000100:00100000:3.0:1788970550.420768:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1788970550.420779:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+12:15576:x1875871082346112:12345-192.168.203.15@tcp:37:lfs.0 00000100:00100000:3.0:1788970550.429469:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+12:15576:x1875871082346112:12345-192.168.203.15@tcp:37:lfs.0 Request processed in 8682us (8866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970550.429483:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:0.0:1788970550.435299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.435742:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082346368 00000100:00100000:2.0:1788970550.435753:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082346368 00000100:00100000:2.0:1788970550.435816:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1788970550.435826:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+12:15576:x1875871082346368:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970550.436474:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+13:15576:x1875871082346368:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 647us (1183us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788970550.436484:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:2.0:1788970550.475355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.475444:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.475487:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.475521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.475544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970550.475737:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082346496 00000100:00100000:1.0:1788970550.475747:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082346496 00000100:00100000:1.0:1788970550.475806:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:1.0:1788970550.475817:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2402:x1875871082346496:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970550.475855:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082346624 00000100:00100000:0.0:1788970550.475860:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082346624 00000100:00100000:1.0:1788970550.475882:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2402:x1875871082346496:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 67us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970550.475890:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 164 00000100:00100000:0.0:1788970550.475895:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082346880 00000100:00100000:0.0:1788970550.475897:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082346880 00000100:00100000:0.0:1788970550.475910:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082346752 00000100:00100000:0.0:1788970550.475912:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082346752 00000100:00100000:0.0:1788970550.475923:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082347008 00000100:00100000:0.0:1788970550.475925:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082347008 00000100:00100000:0.0:1788970550.475938:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970550.475944:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2402:x1875871082346624:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970550.475971:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2402:x1875871082346624:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.475985:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970550.475999:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970550.476005:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2402:x1875871082346880:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970550.476030:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2402:x1875871082346880:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.476037:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970550.476049:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1788970550.476054:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2402:x1875871082346752:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970550.476077:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2402:x1875871082346752:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.476083:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1788970550.476093:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970550.476099:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2402:x1875871082347008:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970550.476120:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2402:x1875871082347008:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.476126:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00080000:0.0:1788970550.476152:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970550.476156:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788970550.497334:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970550.550776:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.555489:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082347136 00000100:00100000:3.0:1788970550.555513:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082347136 00000100:00100000:3.0:1788970550.555578:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:3.0:1788970550.555587:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+11:15583:x1875871082347136:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970550.556575:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970550.556619:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc6e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557276:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557293:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557305:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557315:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557323:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557331:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557433:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7002c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557443:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7002c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557449:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7002c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970550.557496:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970550.557499:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970550.557537:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7002c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557549:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557555:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557561:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557566:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970550.557570:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557577:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557588:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:2.0:1788970550.557591:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970550.557596:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557602:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7001e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557615:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557630:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557636:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557640:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970550.557642:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.557648:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.558775:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a7eb0e83b00) 00010000:00010000:2.0:1788970550.558779:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970550.558784:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.558791:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.558832:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc6e expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.559344:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7002c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc6e expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.559354:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:2.0:1788970550.559357:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788970550.559371:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:2.0:1788970550.559482:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+12:15583:x1875871082347136:12345-192.168.203.15@tcp:101:bash.0 Request processed in 3893us (8714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970550.559491:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:1.0:1788970550.577758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.578855:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082347264 00000100:00100000:0.0:1788970550.578868:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082347264 00000100:00100000:0.0:1788970550.578986:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1788970550.578996:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf375680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:15583:x1875871082347264:12345-192.168.203.15@tcp:900:bash.0 00000100:00100000:0.0:1788970550.579098:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf375680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:15583:x1875871082347264:12345-192.168.203.15@tcp:900:bash.0 Request processed in 104us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970550.579136:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970550.584832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.584923:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082347520 00000100:00100000:3.0:1788970550.584933:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082347520 00000100:00100000:3.0:1788970550.584995:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:3.0:1788970550.585006:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+12:15583:x1875871082347520:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970550.585037:0:19483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.585058:0:19483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c70033 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc75 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.585169:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.585185:0:19483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.585194:0:19483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.585244:0:19483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.585257:0:19483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 12 pid: 17150 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970550.585270:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19483:1875871102346880:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970550.585353:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970550.589872:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19483:1875871102346880:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970550.589902:0:19483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970550.595351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970550.596200:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082347648 00000100:00100000:1.0:1788970550.596212:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082347648 00010000:00010000:1.0:1788970550.596259:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 13 pid: 17150 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970550.596304:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:1.0:1788970550.596315:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+13:2402:x1875871082347648:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970550.596330:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970550.596337:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 13 pid: 17150 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.596350:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 13 pid: 17150 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.596372:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70010 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc67 expref: 13 pid: 17150 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.596441:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:1.0:1788970550.596447:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.596457:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.596465:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970550.596490:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970550.596543:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+12:2402:x1875871082347648:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 230us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970550.596551:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00010000:00010000:3.0:1788970550.598669:0:19483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.598687:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.598720:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.598734:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.598745:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.605881:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.605918:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.605931:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970550.605944:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788970550.605973:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.605981:0:19483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.605989:0:19483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.605995:0:19483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970550.605999:0:19483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606007:0:19483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606018:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:3.0:1788970550.606021:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970550.606026:0:19483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606032:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7003a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970550.606045:0:19483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064d53a85 reply state 00000000ad28be2e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606063:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606069:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a7eb0e83700) 00010000:00010000:3.0:1788970550.606072:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970550.606075:0:19483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788970550.606138:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c70033 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 15 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606155:0:19483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 14 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.606162:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970550.606165:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788970550.606174:0:19483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5200, rc 0) 00000100:00100000:3.0:1788970550.606256:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+15:15583:x1875871082347520:12345-192.168.203.15@tcp:101:bash.0 Request processed in 21251us (21432us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788970550.606265:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:2.0:1788970550.630579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.631631:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082347776 00000100:00100000:3.0:1788970550.631643:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082347776 00000100:00100000:3.0:1788970550.631709:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1788970550.631720:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+15:15583:x1875871082347776:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970550.631756:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970550.631776:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c70056 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc7c expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.631838:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.631864:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.631876:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970550.631920:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788970550.631925:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970550.631943:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.631953:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.631977:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c70056 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc7c expref: 17 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.631994:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc7c expref: 16 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.632003:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970550.632006:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970550.632010:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4a00, rc 0) 00000100:00100000:3.0:1788970550.633414:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+16:15583:x1875871082347776:12345-192.168.203.15@tcp:101:bash.0 Request processed in 1662us (2812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970550.633427:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:2.0:1788970550.638080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.638159:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082348032 00000100:00100000:3.0:1788970550.638169:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082348032 00000100:00100000:3.0:1788970550.638226:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:3.0:1788970550.638251:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+16:15583:x1875871082348032:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:3.0:1788970550.638571:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+17:15583:x1875871082348032:12345-192.168.203.15@tcp:35:bash.0 Request processed in 321us (501us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788970550.638580:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:0.0:1788970550.747997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.748109:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082348288 00000100:00100000:2.0:1788970550.748119:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082348288 00000100:00100000:2.0:1788970550.748201:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:2.0:1788970550.748212:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+17:15593:x1875871082348288:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970550.748248:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970550.748268:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc83 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970550.748370:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788970550.748509:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70064 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc83 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.748523:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:2.0:1788970550.748526:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970550.748532:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc83 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.748545:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655600, rc 0) 00000100:00100000:2.0:1788970550.748616:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+18:15593:x1875871082348288:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 405us (628us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788970550.748640:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:0.0:1788970550.756534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.756625:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082348544 00000100:00100000:3.0:1788970550.756636:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082348544 00000100:00100000:3.0:1788970550.756757:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1788970550.756768:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+18:15593:x1875871082348544:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970550.756996:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+19:15593:x1875871082348544:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 229us (470us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788970550.757004:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000040:00080000:1.0:1788970550.813458:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970550.830505:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.830605:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082348800 00000100:00100000:2.0:1788970550.830616:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082348800 00000100:00100000:2.0:1788970550.830676:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1788970550.830687:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+19:15596:x1875871082348800:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970550.830710:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970550.830745:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70072 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc8a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.830851:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70079 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.830867:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.830879:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970550.830901:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970550.831001:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70072 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc8a expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.831018:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc8a expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.831036:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970550.831040:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970550.831043:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655200, rc 0) 00000100:00100000:2.0:1788970550.831101:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:15596:x1875871082348800:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 417us (608us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788970550.831108:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:0.0:1788970550.842351:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970550.842432:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970550.842510:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082349056 00000100:00100000:3.0:1788970550.842520:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082349056 00000100:00100000:3.0:1788970550.842605:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:3.0:1788970550.842616:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:2402:x1875871082349056:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970550.842633:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970550.842656:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70079 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc8a expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970550.842675:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970550.842681:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970550.842757:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+20:2402:x1875871082349056:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 143us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970550.842764:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:2.0:1788970550.843753:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082348928 00000100:00100000:2.0:1788970550.843762:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082348928 00000100:00100000:2.0:1788970550.843814:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:2.0:1788970550.843824:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+20:15596:x1875871082348928:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:2.0:1788970550.843884:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843912:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843924:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843962:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843970:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843977:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843983:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970550.843988:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.843995:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.844020:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970550.844372:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970550.844409:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970550.844417:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c70087 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970550.844482:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+20:15596:x1875871082348928:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 658us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970550.844489:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:0.0:1788970550.852511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970550.852605:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082349312 00000100:00100000:2.0:1788970550.852615:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082349312 00000100:00100000:2.0:1788970550.852673:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970550.852684:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+20:15596:x1875871082349312:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970550.852936:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:15596:x1875871082349312:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 253us (434us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788970550.852944:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00010000:00010000:3.0:1788970551.004604:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970551.069922:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970551.069946:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102347008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970551.070018:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970551.070328:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102347008 00000100:00100000:2.0:1788970551.070336:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102347008 00000100:00100000:2.0:1788970551.070708:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970551.070719:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102347008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970551.070766:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970551.070822:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102347008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970551.070830:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970551.072969:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102347008:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788970551.084201:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970551.388192:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970551.388301:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082349568 00000100:00100000:2.0:1788970551.388313:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082349568 00000100:00100000:2.0:1788970551.388379:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:2.0:1788970551.388422:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:15627:x1875871082349568:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:2.0:1788970551.388449:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970551.388472:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7008e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc91 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.388585:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70095 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.388599:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70095 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.388611:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70095 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970551.388622:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970551.388756:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c7008e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc91 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.388777:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70095 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc91 expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.388786:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970551.388789:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970551.388793:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654600, rc 0) 00000100:00100000:2.0:1788970551.388861:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+23:15627:x1875871082349568:12345-192.168.203.15@tcp:101:cat.0 Request processed in 440us (678us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788970551.388887:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1788970551.393678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970551.393850:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082349696 00000100:00100000:2.0:1788970551.393860:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082349696 00000100:00100000:2.0:1788970551.394049:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:2.0:1788970551.394060:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+23:2400:x1875871082349696:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970551.394076:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970551.394103:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70095 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc91 expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.394133:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970551.394139:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970551.394200:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+22:2400:x1875871082349696:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 143us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970551.394207:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:0.0:1788970551.411754:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970551.412190:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082349952 00000100:00100000:2.0:1788970551.412203:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082349952 00000100:00100000:2.0:1788970551.412268:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970551.412278:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+22:15627:x1875871082349952:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:2.0:1788970551.412635:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+23:15627:x1875871082349952:12345-192.168.203.15@tcp:35:cat.0 Request processed in 357us (891us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788970551.412644:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1788970551.555911:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970551.556879:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082350208 00000100:00100000:3.0:1788970551.556891:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082350208 00000100:00100000:3.0:1788970551.556978:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:3.0:1788970551.556991:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+23:15633:x1875871082350208:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:3.0:1788970551.557034:0:19483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970551.557058:0:19483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c700a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc98 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.557195:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.557210:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.557221:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970551.557232:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788970551.557361:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c700a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc98 expref: 26 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.557453:0:19483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc98 expref: 25 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.557463:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970551.557465:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970551.557468:0:19483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4c00, rc 0) 00000100:00100000:3.0:1788970551.557572:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15633:x1875871082350208:12345-192.168.203.15@tcp:101:dd.0 Request processed in 585us (1670us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788970551.557579:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:1.0:1788970551.563476:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970551.563540:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970551.563625:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082350336 00000100:00100000:2.0:1788970551.563636:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082350336 00000100:00100000:2.0:1788970551.563703:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:2.0:1788970551.563723:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15633:x1875871082350336:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:2.0:1788970551.563761:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970551.563781:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c700b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dc9f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.563813:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.563828:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.563841:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.563954:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c700b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 27 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.563973:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.563982:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970551.563984:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970551.563988:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655600, rc 0) 00000100:00100000:2.0:1788970551.564064:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+26:15633:x1875871082350336:12345-192.168.203.15@tcp:101:dd.0 Request processed in 343us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970551.564072:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:3.0:1788970551.564817:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082350464 00000100:00100000:3.0:1788970551.564826:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082350464 00000100:00100000:3.0:1788970551.564877:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970551.564887:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+26:2402:x1875871082350464:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970551.564898:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970551.564916:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc98 expref: 26 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.564932:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970551.564936:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970551.564972:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:2402:x1875871082350464:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 88us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970551.564980:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:1.0:1788970551.575806:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970551.575997:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082350720 00000100:00100000:3.0:1788970551.576008:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082350720 00000100:00100000:3.0:1788970551.576075:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:3.0:1788970551.576086:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15633:x1875871082350720:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:3.0:1788970551.576308:0:19483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970551.576334:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c7005d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc7c expref: 25 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.576353:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970551.576358:0:19483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970551.576644:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.576658:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.576668:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970551.576719:0:19483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788970551.576745:0:19483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000677d89a5 reply state 00000000d7f08040 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.576756:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970551.576762:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970551.576765:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970551.576767:0:19483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970551.576972:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+27:15633:x1875871082350720:12345-192.168.203.15@tcp:36:dd.0 Request processed in 888us (1174us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788970551.576980:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000020:00080000:3.0:1788970551.576985:0:19483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788970551.686703:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970551.686798:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082350976 00000100:00100000:2.0:1788970551.686809:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082350976 00000100:00100000:2.0:1788970551.686872:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1788970551.686882:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+27:15633:x1875871082350976:12345-192.168.203.15@tcp:35:dd.0 00000100:00100000:2.0:1788970551.687254:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+28:15633:x1875871082350976:12345-192.168.203.15@tcp:35:dd.0 Request processed in 373us (560us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788970551.687263:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970551.951639:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970551.951747:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082351104 00000100:00100000:2.0:1788970551.951757:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082351104 00000100:00100000:2.0:1788970551.951822:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:2.0:1788970551.951833:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+28:15647:x1875871082351104:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:2.0:1788970551.951857:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970551.951879:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c700cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dca6 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.951944:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.951961:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.951975:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.951987:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.951995:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952001:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952091:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952112:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952128:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970551.952170:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788970551.952175:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970551.952217:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952230:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952238:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952244:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952250:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952255:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970551.952259:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952266:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952276:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:2.0:1788970551.952285:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970551.952290:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952296:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c700d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952311:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952317:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952323:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952329:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970551.952332:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952338:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952345:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a7eb0e83700) 00010000:00010000:2.0:1788970551.952348:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970551.952350:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952356:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c700db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952436:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c700cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dca6 expref: 30 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952473:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dca6 expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970551.952480:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970551.952483:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970551.952485:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99000, rc 0) 00000100:00100000:2.0:1788970551.952548:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+29:15647:x1875871082351104:12345-192.168.203.15@tcp:101:stat.0 Request processed in 717us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970551.952556:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00010000:00010000:1.0:1788970552.028706:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970552.042546:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.043286:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082351360 00000100:00100000:2.0:1788970552.043299:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082351360 00000100:00100000:2.0:1788970552.043378:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:2.0:1788970552.043417:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+29:15652:x1875871082351360:12345-192.168.203.15@tcp:36:truncate.0 00010000:00010000:2.0:1788970552.043473:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970552.043499:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c700e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dca6 expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.043519:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.043524:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970552.043691:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.043706:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.043717:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970552.043779:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788970552.043803:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071088a71 reply state 00000000767e0d0e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.043816:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.043822:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.043825:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970552.043827:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970552.043945:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+31:15652:x1875871082351360:12345-192.168.203.15@tcp:36:truncate.0 Request processed in 530us (1409us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788970552.043952:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000020:00080000:2.0:1788970552.043958:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788970552.044044:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970552.092677:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970552.092704:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaf377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102347136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970552.092798:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970552.092907:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102347136 00000100:00100000:1.0:1788970552.092915:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102347136 00000100:00100000:1.0:1788970552.092972:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970552.092983:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102347136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970552.093036:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970552.093271:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102347136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 289us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.093279:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970552.093359:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaf377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102347136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970552.093509:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102347264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970552.093537:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970552.093610:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102347264 00000100:00100000:0.0:1788970552.093615:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102347264 00000100:00100000:0.0:1788970552.093650:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788970552.093658:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102347264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970552.093678:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788970552.093726:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102347264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.093733:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970552.093892:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102347264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970552.228952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.229065:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082351488 00000100:00100000:0.0:1788970552.229076:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082351488 00000100:00100000:0.0:1788970552.229146:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1788970552.229157:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+31:15667:x1875871082351488:12345-192.168.203.15@tcp:101:stat.0 00010000:00010000:0.0:1788970552.229181:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970552.229214:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c700f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcad expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229277:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229291:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229302:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229313:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229320:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229327:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229451:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229460:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229467:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970552.229511:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788970552.229518:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970552.229540:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229560:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229568:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229575:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229581:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229587:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.229591:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229598:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229614:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:0.0:1788970552.229618:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.229623:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229629:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c700f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229641:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229647:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229659:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229664:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.229666:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229672:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229679:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a7eb0e83700) 00010000:00010000:0.0:1788970552.229681:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.229684:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229688:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c700fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229716:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c700f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 33 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229729:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 32 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.229735:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.229737:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970552.229740:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024800, rc 0) 00000100:00100000:0.0:1788970552.229792:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+32:15667:x1875871082351488:12345-192.168.203.15@tcp:101:stat.0 Request processed in 637us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.229807:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:1.0:1788970552.333950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.334498:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082351744 00000100:00100000:2.0:1788970552.334511:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082351744 00000100:00100000:2.0:1788970552.334578:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:2.0:1788970552.334589:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+32:15677:x1875871082351744:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970552.334609:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.334630:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7010c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcb4 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970552.334757:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788970552.334857:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7010c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcb4 expref: 34 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.334871:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:2.0:1788970552.334874:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970552.334879:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7010c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcb4 expref: 34 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.334893:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99000, rc 0) 00000100:00100000:2.0:1788970552.334956:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+33:15677:x1875871082351744:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 369us (1014us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788970552.334964:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:1.0:1788970552.337844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.337911:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082352000 00000100:00100000:2.0:1788970552.337922:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082352000 00000100:00100000:2.0:1788970552.337973:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970552.337983:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafadac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+33:15677:x1875871082352000:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:2.0:1788970552.338204:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafadac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+34:15677:x1875871082352000:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 222us (367us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788970552.338212:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:1.0:1788970552.407219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.407370:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082352256 00000100:00100000:0.0:1788970552.407414:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082352256 00000100:00100000:0.0:1788970552.407477:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:0.0:1788970552.407487:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+34:15683:x1875871082352256:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970552.407516:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970552.407544:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c7011a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcbb expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407645:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407659:0:17152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 35 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407668:0:17152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407687:0:17152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407720:0:17152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407733:0:17152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 35 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.407746:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1875871102347392:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970552.407912:0:17152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 35 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.407923:0:17152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 35 pid: 19483 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.407931:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1875871102347520:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970552.407955:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea76de300 going to sleep for 11 seconds 00000100:00100000:1.0:1788970552.414415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970552.414459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.414535:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1875871102347392:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970552.414541:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082352384 00000100:00100000:3.0:1788970552.414549:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082352384 00010000:00010000:3.0:1788970552.414587:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 36 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.414627:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082352512 00000100:00100000:0.0:1788970552.414631:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1875871102347520:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970552.414632:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082352512 00010000:00010000:3.0:1788970552.414650:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 37 pid: 19483 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.414658:0:17152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.414688:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1788970552.414698:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83231c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:2403:x1875871082352384:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970552.414712:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970552.414719:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 37 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414731:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 37 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414752:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024800/0xc3abfebe76c70105 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcad expref: 37 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414768:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970552.414773:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414782:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414789:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970552.414837:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83231c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+36:2403:x1875871082352384:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 140us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.414845:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1788970552.414895:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970552.414902:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+35:2403:x1875871082352512:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970552.414920:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970552.414926:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 35 pid: 19483 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414936:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 35 pid: 19483 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414947:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c70048 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc75 expref: 35 pid: 19483 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414959:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970552.414962:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414970:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.414980:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.415006:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970552.415036:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+34:2403:x1875871082352512:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 134us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.415042:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00010000:00010000:0.0:1788970552.415154:0:17152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.415163:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970552.415183:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788970552.415317:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c7011a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.415332:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 34 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.415339:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.415348:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788970552.415450:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024600, rc 0) 00000100:00100000:0.0:1788970552.415481:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+34:15683:x1875871082352256:12345-192.168.203.15@tcp:101:bash.0 Request processed in 7995us (8271us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788970552.415488:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:1.0:1788970552.421266:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.421365:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082352768 00000100:00100000:2.0:1788970552.421375:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082352768 00000100:00100000:2.0:1788970552.423605:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1788970552.423627:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+34:15683:x1875871082352768:12345-192.168.203.15@tcp:36:bash.0 00010000:00010000:2.0:1788970552.423865:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.423900:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.423913:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970552.423957:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788970552.423980:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8c9e593 reply state 00000000619d4b03 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.423992:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.424000:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.424003:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970552.424008:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970552.424121:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15683:x1875871082352768:12345-192.168.203.15@tcp:36:bash.0 Request processed in 496us (2856us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788970552.424129:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000020:00080000:2.0:1788970552.424134:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788970552.426529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.426636:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082352896 00000100:00100000:2.0:1788970552.426646:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082352896 00000100:00100000:2.0:1788970552.426742:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:2.0:1788970552.426753:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15683:x1875871082352896:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970552.426775:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.426793:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70136 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcc2 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.426845:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70136 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcc2 expref: 38 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.426872:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70136 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcc2 expref: 38 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.426890:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.426894:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970552.426898:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99a00, rc 0) 00000100:00100000:2.0:1788970552.426948:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15683:x1875871082352896:12345-192.168.203.15@tcp:101:bash.0 Request processed in 197us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.426954:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:1.0:1788970552.432820:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.432897:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353024 00000100:00100000:3.0:1788970552.432907:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353024 00000100:00100000:3.0:1788970552.432962:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:3.0:1788970552.432972:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15683:x1875871082353024:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970552.433005:0:19483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970552.433033:0:19483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c7013d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcc9 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.433132:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.433148:0:19483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.433157:0:19483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.433190:0:19483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.433203:0:19483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 39 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.433217:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19483:1875871102347648:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970552.433553:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e883dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970552.436010:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19483:1875871102347648:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970552.436041:0:19483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970552.437230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.437488:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353152 00000100:00100000:3.0:1788970552.437498:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353152 00010000:00010000:3.0:1788970552.437534:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 40 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.437629:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:3.0:1788970552.437639:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+40:2402:x1875871082353152:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970552.437654:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970552.437662:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 40 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.437674:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 40 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.437694:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70121 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcbb expref: 40 pid: 17152 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.437710:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970552.437715:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.437734:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.437742:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.437777:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970552.437897:0:19483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.437905:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970552.437962:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788970552.437967:0:19483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970552.437988:0:19483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.438087:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+40:2402:x1875871082353152:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 449us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.438093:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00010000:00010000:0.0:1788970552.438207:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5200/0xc3abfebe76c7013d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcc9 expref: 39 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.438226:0:19483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcc9 expref: 38 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.438237:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.438240:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970552.438243:0:19483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4a00, rc 0) 00000100:00100000:0.0:1788970552.438268:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15683:x1875871082353024:12345-192.168.203.15@tcp:101:bash.0 Request processed in 5298us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.438275:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:1.0:1788970552.442202:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.442649:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353408 00000100:00100000:2.0:1788970552.442661:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353408 00000100:00100000:2.0:1788970552.442738:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1788970552.442749:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15683:x1875871082353408:12345-192.168.203.15@tcp:103:bash.0 00010000:00010000:2.0:1788970552.442765:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788970552.442789:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70136 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcc2 expref: 38 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.442812:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4a00/0xc3abfebe76c70144 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcc9 expref: 37 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.442823:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.442828:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970552.444470:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+36:15683:x1875871082353408:12345-192.168.203.15@tcp:103:bash.0 Request processed in 1714us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.444484:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:1.0:1788970552.453904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.459541:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353536 00000100:00100000:0.0:1788970552.459703:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353536 00000100:00100000:1.0:1788970552.460479:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:1.0:1788970552.460491:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+36:15683:x1875871082353536:12345-192.168.203.15@tcp:58:bash.0 00010000:00010000:1.0:1788970552.460625:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.460643:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.460654:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970552.464281:0:17152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970552.464324:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788970552.464525:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788970552.464797:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+36:15683:x1875871082353536:12345-192.168.203.15@tcp:58:bash.0 Request processed in 4303us (10898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.464810:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:1.0:1788970552.469282:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.469549:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353664 00000100:00100000:2.0:1788970552.469560:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353664 00000100:00100000:2.0:1788970552.469704:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:2.0:1788970552.469714:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+36:15683:x1875871082353664:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970552.469733:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.469751:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcd0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.469798:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.469806:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.469822:0:17150:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.469833:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.469854:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.469856:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970552.469860:0:17150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.469867:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99a00, rc 0) 00000100:00100000:2.0:1788970552.469915:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15683:x1875871082353664:12345-192.168.203.15@tcp:101:bash.0 Request processed in 204us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.469920:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000040:00080000:1.0:1788970552.540585:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788970552.540594:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970552.540635:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788970552.540644:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788970552.540774:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827e30c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17184:1875871102347776:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970552.540976:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970552.557448:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827e30c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17184:1875871102347776:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970552.559039:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.559236:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353792 00000100:00100000:2.0:1788970552.559245:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353792 00000100:00100000:2.0:1788970552.559300:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:2.0:1788970552.559309:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15684:x1875871082353792:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970552.559338:0:17151:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970552.559491:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15684:x1875871082353792:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 182us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.559503:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1788970552.576808:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.577336:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082353920 00000100:00100000:0.0:1788970552.577347:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082353920 00000100:00100000:0.0:1788970552.577442:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:0.0:1788970552.577452:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15684:x1875871082353920:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788970552.577521:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577538:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577548:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577608:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577617:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577623:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577644:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577654:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577660:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970552.577714:0:19483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788970552.577718:0:19483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970552.577733:0:19483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577744:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577751:0:19483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577757:0:19483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577763:0:19483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.577767:0:19483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577774:0:19483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577786:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7eb0e83300) 00010000:00010000:0.0:1788970552.577789:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.577793:0:19483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577799:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024400/0xc3abfebe76c70159 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577811:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577827:0:19483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577846:0:19483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577851:0:19483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.577854:0:19483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577860:0:19483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577867:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a7d83361800) 00010000:00010000:0.0:1788970552.577869:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.577873:0:19483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577880:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c70160 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577894:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577900:0:19483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577907:0:19483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577912:0:19483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.577921:0:19483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577928:0:19483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577936:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.577939:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.577942:0:19483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.577948:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024600/0xc3abfebe76c70167 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.578085:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15684:x1875871082353920:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 632us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.578094:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:0.0:1788970552.587095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.587220:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082354176 00000100:00100000:2.0:1788970552.587235:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082354176 00000100:00100000:2.0:1788970552.587294:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1788970552.587305:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+37:15684:x1875871082354176:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970552.587325:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.587345:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c7016e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcd7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587478:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587494:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587506:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970552.587516:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970552.587601:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587625:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587632:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587637:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.587642:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587649:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587661:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.587663:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970552.587667:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587673:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c70175 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587713:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c7016e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd7 expref: 39 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587722:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7eb0e83300) 00010000:00010000:2.0:1788970552.587724:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970552.587727:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c7016e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd7 expref: 39 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.587736:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98200, rc 0) 00000100:00100000:2.0:1788970552.587797:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15684:x1875871082354176:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 493us (712us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788970552.587804:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1788970552.594237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.594358:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082354304 00000100:00100000:0.0:1788970552.594369:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082354304 00000100:00100000:0.0:1788970552.594458:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970552.594468:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15684:x1875871082354304:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788970552.594502:0:19483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788970552.594760:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15684:x1875871082354304:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 293us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.594768:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970552.603022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.603182:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082354560 00000100:00100000:2.0:1788970552.603192:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082354560 00000100:00100000:2.0:1788970552.603252:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1788970552.603263:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+38:15684:x1875871082354560:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970552.603285:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.603306:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70183 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcde expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970552.603703:0:17151:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1788970552.603710:0:17151:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788970552.603729:0:17151:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788970552.603869:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c7018a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.603884:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c7018a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.603895:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c7018a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.603942:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70183 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcde expref: 41 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.603959:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c7018a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcde expref: 40 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.603984:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7e88bd6f00) 00010000:00010000:2.0:1788970552.603987:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970552.603990:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98e00, rc 0) 00000100:00100000:2.0:1788970552.604247:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+40:15684:x1875871082354560:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 985us (1243us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788970552.604255:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:0.0:1788970552.612520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.612972:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082354816 00000100:00100000:2.0:1788970552.612985:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082354816 00000100:00100000:2.0:1788970552.613221:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1788970552.613233:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+40:15684:x1875871082354816:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970552.613309:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970552.613336:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98e00/0xc3abfebe76c7018a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcde expref: 40 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613355:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7e88bd6f00) 00010000:00010000:2.0:1788970552.613366:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970552.613433:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613447:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613457:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613470:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613488:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613495:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613544:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613553:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613560:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613565:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.613579:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613711:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613720:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:2.0:1788970552.613733:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970552.613739:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613745:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c70198 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613755:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613768:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613773:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613778:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.613781:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613788:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613796:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4990f0d2 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970552.613798:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970552.613801:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.613807:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99600/0xc3abfebe76c7019f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4990f0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970552.613910:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+39:15684:x1875871082354816:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 679us (1398us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970552.613919:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:1.0:1788970552.618425:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.618703:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082354944 00000100:00100000:3.0:1788970552.618735:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082354944 00000100:00100000:3.0:1788970552.618789:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:3.0:1788970552.618798:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+39:15684:x1875871082354944:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970552.618819:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970552.619006:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c701a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dce5 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.619105:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c701ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.619127:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c701ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.619139:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c701ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.619242:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4600/0xc3abfebe76c701a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dce5 expref: 41 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.619261:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c701ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dce5 expref: 40 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.619270:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:3.0:1788970552.619273:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970552.619277:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5e00, rc 0) 00000100:00100000:3.0:1788970552.619339:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+40:15684:x1875871082354944:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 542us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.619346:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:1.0:1788970552.623476:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.623691:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082355200 00000100:00100000:0.0:1788970552.623710:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082355200 00000100:00100000:0.0:1788970552.623762:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1788970552.623772:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+40:15684:x1875871082355200:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788970552.623853:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.623870:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.623881:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970552.624044:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788970552.624055:0:19483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 571890673054ns, next at 572890669569ns, rc = 0 00000004:00010000:0.0:1788970552.624100:0:19483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef04cd7e reply state 000000008f871a94 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.624124:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.624132:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:0.0:1788970552.624135:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788970552.624138:0:19483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788970552.624271:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+42:15684:x1875871082355200:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 499us (801us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788970552.624278:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1788970552.629258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.629349:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082355328 00000100:00100000:3.0:1788970552.629373:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082355328 00000100:00100000:2.0:1788970552.629774:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:2.0:1788970552.629787:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+42:15684:x1875871082355328:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970552.629812:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.629832:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcec expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.629913:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 43 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.629927:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 43 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.629944:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:2.0:1788970552.629948:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970552.629952:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99e00, rc 0) 00000100:00100000:2.0:1788970552.630120:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+43:15684:x1875871082355328:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 328us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.630127:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:2.0:1788970552.634188:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.636490:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082355456 00000100:00100000:0.0:1788970552.636504:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082355456 00000100:00100000:0.0:1788970552.636589:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1788970552.636616:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2403:x1875871082355456:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788970552.636880:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2403:x1875871082355456:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 246us (2678us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788970552.636888:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00080000:3.0:1788970552.637242:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970552.640214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.640373:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082355712 00000100:00100000:2.0:1788970552.640448:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082355712 00000100:00100000:2.0:1788970552.640540:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1788970552.640550:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+43:15684:x1875871082355712:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970552.640775:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+44:15684:x1875871082355712:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 226us (568us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788970552.640784:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:1.0:1788970552.643545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.643648:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082355968 00000100:00100000:0.0:1788970552.643658:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082355968 00000100:00100000:0.0:1788970552.643755:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:0.0:1788970552.643766:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+44:15684:x1875871082355968:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788970552.643888:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+44:15684:x1875871082355968:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 124us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.643896:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:1.0:1788970552.646558:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.646705:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082356096 00000100:00100000:2.0:1788970552.646715:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082356096 00000100:00100000:2.0:1788970552.646952:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:2.0:1788970552.646962:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+44:15684:x1875871082356096:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970552.646980:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970552.647189:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c701c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcf3 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.647253:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c701c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.647268:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c701c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.647279:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c701c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970552.647319:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970552.647337:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c701c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.647363:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98200/0xc3abfebe76c701c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcf3 expref: 46 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.647509:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c701c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcf3 expref: 45 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.647520:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:2.0:1788970552.647523:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788970552.647526:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98400, rc 0) 00000100:00100000:2.0:1788970552.647583:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+45:15684:x1875871082356096:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 622us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.647590:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 66 00000100:00100000:0.0:1788970552.651764:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.651856:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082356224 00000100:00100000:3.0:1788970552.651867:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082356224 00000100:00100000:3.0:1788970552.651920:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1788970552.651930:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2403:x1875871082356224:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970552.651947:0:19710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970552.651964:0:19710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dcfa expref: -99 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970552.651988:0:19710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18638, blocks: 0x0 00010000:00010000:3.0:1788970552.652008:0:19710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1788970552.652728:0:19710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970552.652739:0:19710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 7 pid: 19710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.652762:0:19710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 7 pid: 19710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.652776:0:19710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4600, rc 0) 00000100:00100000:3.0:1788970552.653678:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2403:x1875871082356224:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 907us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.653689:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:1.0:1788970552.656605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.656686:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082356480 00000100:00100000:3.0:1788970552.656696:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082356480 00000100:00100000:3.0:1788970552.656752:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:3.0:1788970552.656762:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+45:15684:x1875871082356480:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970552.656883:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+45:15684:x1875871082356480:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.656892:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 67 00000100:00100000:1.0:1788970552.660303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.660433:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082356608 00000100:00100000:0.0:1788970552.660443:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082356608 00000100:00100000:0.0:1788970552.660493:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 68 00000100:00100000:0.0:1788970552.660503:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+45:15684:x1875871082356608:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788970552.662806:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788970552.662821:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788970552.662973:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.662986:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.662994:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663000:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663023:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663031:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663049:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a7eb0e83b00) 00010000:00010000:0.0:1788970552.663053:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.663058:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663065:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c6ff92 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663085:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663092:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663108:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663122:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663125:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663131:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663139:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:0.0:1788970552.663142:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.663151:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663157:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c6ff99 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663170:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663175:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663181:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663186:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663189:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663194:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663201:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a7eb0e83700) 00010000:00010000:0.0:1788970552.663203:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.663206:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663211:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4800/0xc3abfebe76c70041 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663224:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663240:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663246:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663251:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663254:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663259:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663267:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.663269:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.663273:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663278:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4c00/0xc3abfebe76c700c6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663290:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663295:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663300:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663305:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663314:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663319:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663328:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.663330:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.663332:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663337:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99c00/0xc3abfebe76c700e9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663347:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663354:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663359:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663363:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663366:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663372:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663401:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.663403:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.663413:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663419:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99000/0xc3abfebe76c7012f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663430:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663437:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663443:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663448:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.663451:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663457:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663465:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:0.0:1788970552.663467:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788970552.663471:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.663476:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025c00/0xc3abfebe76c701b4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970552.664029:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970552.664048:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102347904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788970552.664131:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970552.664310:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102347904 00000100:00100000:2.0:1788970552.664318:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102347904 00000100:00100000:2.0:1788970552.664406:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970552.664415:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102347904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788970552.664535:0:18653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788970552.664538:0:18653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788970552.664541:0:18653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788970552.664543:0:18653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788970552 -> 1788970552 00002000:00010000:2.0:1788970552.664545:0:18653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788970552.664589:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102347904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (457us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788970552.664596:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1788970552.664733:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7d83e8da40/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788970552.664746:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102347904:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788970552.664761:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788970552.665004:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788970552.665278:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+14:15684:x1875871082356608:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 4773us (4982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.665287:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 68 00010000:00010000:2.0:1788970552.670169:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.670188:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.670197:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.670204:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.670209:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.670218:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.670235:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:2.0:1788970552.670238:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788970552.670243:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.670269:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83024e00/0xc3abfebe76c6ffe6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970552.670666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.670728:0:19264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082356736 00000100:00100000:0.0:1788970552.670737:0:19264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082356736 00000100:00100000:0.0:1788970552.670819:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1788970552.670830:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2402:x1875871082356736:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788970552.670940:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2402:x1875871082356736:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 112us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.670948:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:1.0:1788970552.674247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.674457:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082356992 00000100:00100000:3.0:1788970552.674467:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082356992 00000100:00100000:3.0:1788970552.674526:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:3.0:1788970552.674537:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+14:15684:x1875871082356992:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970552.674593:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970552.674619:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98400/0xc3abfebe76c701c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcf3 expref: 14 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.674638:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:3.0:1788970552.674643:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970552.674676:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.674689:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.674698:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970552.674825:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cdc39aa reply state 00000000ce813cf8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.674985:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.675007:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:3.0:1788970552.675019:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970552.675022:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970552.675193:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+15:15684:x1875871082356992:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 656us (952us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788970552.675201:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 69 00000100:00100000:1.0:1788970552.678331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.678537:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082357120 00000100:00100000:3.0:1788970552.678547:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082357120 00000100:00100000:3.0:1788970552.678600:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1788970552.678610:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:15684:x1875871082357120:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970552.678628:0:19710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970552.678645:0:19710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd01 expref: -99 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.678677:0:19710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.678687:0:19710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970552.678692:0:19710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970552.678698:0:19710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 8 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.678731:0:19710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.678746:0:19710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.678774:0:19710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19710:1875871102348032:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970552.679331:0:19710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970552.682776:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.682886:0:19710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19710:1875871102348032:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970552.682920:0:19710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 8 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.682941:0:19710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5800, rc 0) 00000100:00100000:3.0:1788970552.683003:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:15684:x1875871082357120:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 4392us (4681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.683011:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1788970552.683678:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082357248 00000100:00100000:1.0:1788970552.683686:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082357248 00010000:00010000:1.0:1788970552.683717:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970552.683754:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:1.0:1788970552.683762:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2403:x1875871082357248:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970552.683776:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970552.683799:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.683812:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.683844:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adffa60e/0xc3abfebe76c701d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcfa expref: 8 pid: 19710 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.683860:0:17135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970552.683864:0:17135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970552.683870:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 7 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.683901:0:17135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 7 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.683935:0:17135:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 7 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970552.683949:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827e0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17135:1875871102348160:192.168.203.15@tcp:105: 00000100:00100000:1.0:1788970552.684556:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82591e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970552.687368:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827e0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17135:1875871102348160:192.168.203.15@tcp:105: 00010000:00010000:1.0:1788970552.687421:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970552.687474:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2403:x1875871082357248:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 3713us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.687484:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:2.0:1788970552.689318:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.689421:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082357376 00000100:00100000:0.0:1788970552.689432:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082357376 00000100:00100000:0.0:1788970552.689486:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970552.689497:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2400:x1875871082357376:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788970552.689632:0:18654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788970552.689636:0:18654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788970552 00002000:00010000:0.0:1788970552.689638:0:18654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788970550 00002000:00010000:0.0:1788970552.689641:0:18654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788970552 -> 1788970552 00002000:00010000:0.0:1788970552.689643:0:18654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788970552.689689:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2400:x1875871082357376:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 194us (378us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788970552.689696:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1788970552.694076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.694311:0:19264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082357504 00000100:00100000:0.0:1788970552.694322:0:19264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082357504 00000100:00100000:0.0:1788970552.694418:0:19264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:0.0:1788970552.694429:0:19264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2401:x1875871082357504:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788970552.694473:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.694510:0:19264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 8 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.694518:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970552.694522:0:19264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970552.694527:0:19264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.694562:0:19264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 8 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.694576:0:19264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 8 pid: 19710 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.694591:0:19264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19264:1875871102348288:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970552.694668:0:19264:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970552.697521:0:19264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19264:1875871102348288:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970552.697548:0:19264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970552.700275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970552.700397:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082357632 00000100:00100000:1.0:1788970552.700407:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082357632 00010000:00010000:1.0:1788970552.700447:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 9 pid: 19710 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970552.700524:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:1.0:1788970552.700534:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+9:2402:x1875871082357632:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970552.700549:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970552.700569:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 9 pid: 19710 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.700602:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 9 pid: 19710 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.700624:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e956bd/0xc3abfebe76c701de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd01 expref: 9 pid: 19710 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.700642:0:17136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970552.700646:0:17136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970552.700652:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.700660:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.700696:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970552.700764:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2402:x1875871082357632:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 231us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.700771:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00010000:00010000:2.0:1788970552.700826:0:19264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701276:0:19264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701298:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701306:0:19264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701314:0:19264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701320:0:19264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970552.701324:0:19264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701345:0:19264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701360:0:19264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.701367:0:19264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085366c19/0xc3abfebe76c701e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970552.701454:0:19264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:2401:x1875871082357504:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 7026us (7387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.701462:0:19264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:2.0:1788970552.704564:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.704634:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082357888 00000100:00100000:3.0:1788970552.704644:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082357888 00000100:00100000:3.0:1788970552.704702:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 70 00000100:00100000:3.0:1788970552.704711:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+15:15684:x1875871082357888:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788970552.704795:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.704812:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.704821:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.704864:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.704889:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 15 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.704903:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1875871102348416:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970552.704975:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970552.708074:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.708329:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1875871102348416:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970552.708355:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.709802:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082358016 00000100:00100000:0.0:1788970552.709814:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082358016 00010000:00010000:0.0:1788970552.709921:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.709967:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1788970552.709977:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+16:2402:x1875871082358016:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970552.709991:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970552.709998:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710011:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710163:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655600/0xc3abfebe76c700bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc9f expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710182:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.710188:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 15 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710198:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710206:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710213:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.710288:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970552.710346:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+15:2402:x1875871082358016:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 369us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.710363:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:3.0:1788970552.710519:0:17150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.710528:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.710722:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.710809:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.710817:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.710919:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.710935:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 15 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.710949:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827e92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1875871102348544:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970552.711079:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970552.715559:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.715622:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082358144 00000100:00100000:0.0:1788970552.715632:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082358144 00010000:00010000:0.0:1788970552.715668:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970552.715705:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:0.0:1788970552.715715:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83233c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+16:2403:x1875871082358144:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970552.715738:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970552.715745:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.715758:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 16 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.715779:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:0.0:1788970552.715784:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.715794:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.715801:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.715821:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970552.715994:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83233c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+16:2403:x1875871082358144:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 279us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970552.717310:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00010000:00010000:3.0:1788970552.718533:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c701bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcec expref: 15 pid: 17151 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970552.718556:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827e92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1875871102348544:192.168.203.15@tcp:104: 00010000:00010000:3.0:1788970552.718582:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.718784:0:17150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.718792:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970552.718962:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788970552.719223:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788970552.719263:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788970552.719342:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17150:1875871102348672:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788970552.719579:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970552.719648:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ebb8cf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970552.719686:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102348672 00000100:00100000:1.0:1788970552.719693:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102348672 00000100:00100000:1.0:1788970552.719767:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788970552.719777:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17150:x1875871102348672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788970552.719921:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17150:x1875871102348672:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.719944:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788970552.720206:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17150:1875871102348672:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788970552.720373:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788970552.720530:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17150:1875871102348800:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788970552.720562:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970552.720589:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970552.720638:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102348800 00000100:00100000:3.0:1788970552.720643:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102348800 00000100:00100000:3.0:1788970552.720678:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788970552.720685:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17150:x1875871102348800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788970552.720795:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17150:x1875871102348800:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (232us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788970552.720803:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970552.720951:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17150:1875871102348800:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788970552.720983:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.720999:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721007:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721084:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.721090:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721172:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721189:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:2.0:1788970552.721192:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970552.721197:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721203:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4400/0xc3abfebe76c701f3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721234:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721241:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721246:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721251:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.721261:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721267:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721275:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.721278:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970552.721284:0:17150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721296:0:17150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721304:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.721353:0:17150:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970552.721365:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1875871102348928:192.168.203.15@tcp:105: 00000100:00100000:2.0:1788970552.721455:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea77ee000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970552.726147:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.726225:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1875871102348928:192.168.203.15@tcp:105: 00010000:00010000:0.0:1788970552.726254:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726266:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c7014b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726300:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726314:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726325:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726336:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726356:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726364:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726370:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.726374:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726405:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726419:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.726422:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970552.726425:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726431:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c701fa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726440:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726446:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726452:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726457:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970552.726465:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726472:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726480:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:0.0:1788970552.726482:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970552.726485:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.726491:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4200/0xc3abfebe76c701ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970552.726712:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788970552.726717:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970552.726746:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788970552.726756:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788970552.727248:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082358272 00000100:00100000:3.0:1788970552.727257:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082358272 00000100:00100000:3.0:1788970552.727301:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1788970552.727311:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+19:15683:x1875871082358272:12345-192.168.203.15@tcp:49:bash.0 00000100:00100000:0.0:1788970552.727568:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+19:15684:x1875871082357888:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 22857us (23011us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788970552.727577:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 70 00000020:00080000:0.0:1788970552.727583:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788970552.727646:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+18:15683:x1875871082358272:12345-192.168.203.15@tcp:49:bash.0 Request processed in 336us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970552.727655:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:3.0:1788970552.736473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.736518:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970552.736543:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082358656 00000100:00100000:3.0:1788970552.736552:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082358656 00000100:00100000:3.0:1788970552.736598:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:3.0:1788970552.736622:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+18:15684:x1875871082358656:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788970552.736810:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082358400 00000100:00100000:1.0:1788970552.736815:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082358400 00000100:00100000:1.0:1788970552.736857:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:1.0:1788970552.736865:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+7:15683:x1875871082358400:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970552.736875:0:19710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970552.736891:0:19710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c70201 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd08 expref: -99 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970552.736915:0:19710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa18638, atime: 0x6aa18636, ctime: 0x6aa18638, blocks: 0x0 00010000:00010000:1.0:1788970552.736933:0:19710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1788970552.736937:0:19710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970552.736946:0:19710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c70201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd08 expref: 8 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.736962:0:19710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c70201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd08 expref: 8 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.736976:0:19710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ac00, rc 0) 00000100:00100000:1.0:1788970552.737035:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:15683:x1875871082358400:12345-192.168.203.15@tcp:101:bash.0 Request processed in 171us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.737043:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000004:00080000:3.0:1788970552.739633:0:17154:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788970552.739664:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788970552.739697:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.739714:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.739727:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.739735:0:17154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.739742:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.739748:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970552.739775:0:17154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970552.739957:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970552.739965:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.739972:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970552.739977:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.739995:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.740007:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:2.0:1788970552.740020:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788970552.740026:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.740032:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5c00/0xc3abfebe76c70208 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.740047:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970552.740049:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970552.740050:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970552.740193:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970552.740539:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082358784 00000100:00100000:1.0:1788970552.740547:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082358784 00000100:00100000:1.0:1788970552.740602:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:1.0:1788970552.740613:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:15683:x1875871082358784:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:1.0:1788970552.740639:0:19483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970552.740653:0:19483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7020f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd0f expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.740678:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ae00/0xc3abfebe76c70216 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.740688:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ae00/0xc3abfebe76c70216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.740697:0:19483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ae00/0xc3abfebe76c70216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.740789:0:19483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7020f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd0f expref: 23 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.740804:0:19483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ae00/0xc3abfebe76c70216 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd0f expref: 22 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970552.740812:0:19483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:1.0:1788970552.740815:0:19483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970552.740818:0:19483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ae00, rc 0) 00000100:00100000:1.0:1788970552.741058:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+22:15683:x1875871082358784:12345-192.168.203.15@tcp:101:bash.0 Request processed in 446us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970552.741065:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 71 00000100:00100000:3.0:1788970552.741253:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:15684:x1875871082358656:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 4632us (4733us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788970552.741262:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00000020:00080000:3.0:1788970552.741266:0:17154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970552.746773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.747132:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082359040 00000100:00100000:0.0:1788970552.747141:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082359040 00000100:00100000:0.0:1788970552.747194:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970552.747205:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+21:15683:x1875871082359040:12345-192.168.203.15@tcp:35:bash.0 00000001:00080000:0.0:1788970552.747481:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1788970552.747575:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+23:15683:x1875871082359040:12345-192.168.203.15@tcp:35:bash.0 Request processed in 371us (808us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1788970552.747582:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000020:00080000:0.0:1788970552.747594:0:17154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788970552.844991:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.845239:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082359296 00000100:00100000:0.0:1788970552.845249:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082359296 00000100:00100000:0.0:1788970552.845352:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:0.0:1788970552.845363:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+23:15694:x1875871082359296:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970552.845429:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970552.845450:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c7021d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd16 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970552.845543:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788970552.845634:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c7021d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd16 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.845648:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:0.0:1788970552.845651:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970552.845656:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025000/0xc3abfebe76c7021d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd16 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970552.845669:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025000, rc 0) 00000100:00100000:0.0:1788970552.845736:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+24:15694:x1875871082359296:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 374us (753us total) trans 8589934633 rc 301/301 00000100:00100000:0.0:1788970552.845743:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:1.0:1788970552.849125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970552.849719:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082359424 00000100:00100000:2.0:1788970552.849737:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082359424 00000100:00100000:2.0:1788970552.849819:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:2.0:1788970552.849829:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+24:15694:x1875871082359424:12345-192.168.203.15@tcp:34:lfs.0 00010000:00010000:2.0:1788970552.849897:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.849913:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.849926:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.849939:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.849958:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.849965:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850043:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850053:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850061:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970552.850122:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850136:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850144:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850151:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850157:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.850161:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850168:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850187:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:2.0:1788970552.850190:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970552.850195:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850202:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99800/0xc3abfebe76c7022b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850214:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850221:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850226:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850231:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.850233:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850238:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850245:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a7e88bd6500) 00010000:00010000:2.0:1788970552.850246:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970552.850249:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850254:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed98c00/0xc3abfebe76c70232 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850278:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850284:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850290:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850295:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970552.850298:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850304:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850312:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:2.0:1788970552.850315:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970552.850317:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970552.850322:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99e00/0xc3abfebe76c70239 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970552.850429:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+24:15694:x1875871082359424:12345-192.168.203.15@tcp:34:lfs.0 Request processed in 601us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970552.850437:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:2.0:1788970552.853756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970552.853833:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082359680 00000100:00100000:0.0:1788970552.853842:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082359680 00000100:00100000:0.0:1788970552.853925:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970552.853936:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+24:15694:x1875871082359680:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970552.854278:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15694:x1875871082359680:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 343us (529us total) trans 8589934634 rc 0/0 00000100:00100000:0.0:1788970552.854299:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000040:00080000:1.0:1788970552.861231:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788970553.052622:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970553.629315:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102349056:0@lo:400:kworker.0 00000100:00100000:3.0:1788970553.629409:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970553.631292:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349056 00000100:00100000:1.0:1788970553.631303:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349056 00000100:00100000:1.0:1788970553.631367:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788970553.631376:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102349056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970553.634818:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970553.634896:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970553.636805:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102349056:12345-0@lo:400:kworker.0 Request processed in 5422us (7387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970553.636821:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788970553.636898:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102349312:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.637068:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102349440:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.637116:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.637168:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102349184:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.637195:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.637215:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d827e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970553.637341:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970553.637368:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102349824:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.637463:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.637497:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349184 00000100:00100000:0.0:1788970553.637503:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349184 00000100:00100000:0.0:1788970553.637543:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970553.637549:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.637557:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102349184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970553.637590:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349440 00000100:00100000:1.0:1788970553.637596:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349440 00000100:00100000:0.0:1788970553.637621:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102349184:12345-0@lo:400:kworker.0 Request processed in 66us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970553.637630:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349312 00000100:00100000:0.0:1788970553.637630:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970553.637635:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349312 00000100:00100000:0.0:1788970553.637677:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102349184:0@lo:400:kworker.0 00000100:00100000:1.0:1788970553.637749:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788970553.637759:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102349440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970553.637799:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102349440:12345-0@lo:400:kworker.0 Request processed in 43us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970553.637806:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788970553.637822:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970553.637829:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102349312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970553.637859:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102349312:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970553.637865:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970553.637897:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349568 00000100:00100000:0.0:1788970553.637902:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349568 00000100:00100000:0.0:1788970553.637923:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349696 00000100:00100000:0.0:1788970553.637926:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349696 00000100:00100000:0.0:1788970553.637939:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970553.637946:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102349568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970553.637972:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788970553.638016:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102349568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (3118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.638023:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970553.638051:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970553.638057:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102349696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970553.638071:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788970553.638098:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875871102349696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.638103:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970553.638132:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102350208:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.638156:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.638175:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102350720:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.638194:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.638559:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d827e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970553.638574:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788970553.638580:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102350336:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.638603:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.638619:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102350848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.638634:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.638657:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350208 00000100:00100000:0.0:1788970553.638660:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350208 00000100:00100000:0.0:1788970553.638684:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970553.638690:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102350208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.638719:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102350208:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.638725:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970553.638929:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102350208:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.638954:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349824 00000100:00100000:0.0:1788970553.638966:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349824 00000100:00100000:0.0:1788970553.639140:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350720 00000100:00100000:0.0:1788970553.639145:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350720 00000100:00100000:0.0:1788970553.639165:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350336 00000100:00100000:0.0:1788970553.639168:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350336 00000100:00100000:0.0:1788970553.639178:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350848 00000100:00100000:0.0:1788970553.639181:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350848 00000100:00100000:0.0:1788970553.639195:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970553.639201:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102349824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639248:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102349824:12345-0@lo:400:kworker.0 Request processed in 48us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.639255:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970553.639266:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970553.639271:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102350720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639298:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102350720:12345-0@lo:400:kworker.0 Request processed in 27us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.639303:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970553.639312:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970553.639317:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639336:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102350336:12345-0@lo:400:kworker.0 Request processed in 19us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.639341:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970553.639354:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788970553.639362:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102350848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639419:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102350848:12345-0@lo:400:kworker.0 Request processed in 50us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.639428:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788970553.639469:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102350336:0@lo:400:kworker.0 00010000:00080000:0.0:1788970553.639482:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf376940 x1875871102350848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970553.639492:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102350848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639504:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102350720:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639559:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102349952:0@lo:400:kworker.0 00000100:00080000:2.0:1788970553.639583:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970553.639589:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788970553.639590:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970553.639602:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970553.639605:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970553.639615:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102350464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639637:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970553.639654:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102349312:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102350976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970553.639672:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102349824:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.639685:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.639713:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788970553.639714:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102349952 00000100:00100000:2.0:1788970553.639719:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102349952 00000100:00100000:0.0:1788970553.639730:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788970553.639739:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102350080:0@lo:400:kworker.0 00000100:00100000:2.0:1788970553.639754:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970553.639761:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970553.639801:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102349952:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970553.639807:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788970553.640016:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.640046:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102350592:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.640067:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970553.640086:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102349952:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.640117:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350976 00000100:00100000:0.0:1788970553.640120:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350976 00000100:00100000:0.0:1788970553.640145:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970553.640151:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102350976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970553.640163:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788970553.640206:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102350976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.640212:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970553.640249:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350464 00000100:00100000:0.0:1788970553.640253:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350464 00000100:00100000:0.0:1788970553.640278:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350592 00000100:00100000:0.0:1788970553.640280:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350592 00000100:00100000:0.0:1788970553.640294:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970553.640299:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102350464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.640325:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102350464:12345-0@lo:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.640330:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970553.640341:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970553.640347:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102350592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.640369:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102350592:12345-0@lo:400:kworker.0 Request processed in 23us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970553.640375:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788970553.640423:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377480 x1875871102350592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970553.640433:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788970553.640446:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102349056:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.640449:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102350464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970553.640472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102350976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970553.640484:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102349568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788970553.640501:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970553.640505:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970553.640536:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102350080 00000100:00100000:1.0:1788970553.640542:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102350080 00000100:00100000:1.0:1788970553.640589:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970553.640596:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970553.640645:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102350080:12345-0@lo:400:kworker.0 Request processed in 49us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970553.640652:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970553.640691:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102350080:0@lo:400:kworker.0 00000100:00080000:0.0:1788970553.640853:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788970554.076644:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970554.508178:0:20326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788970555.100570:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970555.593656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593706:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593759:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593799:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593836:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593858:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593882:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970555.593908:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360064 00000100:00100000:0.0:1788970555.593917:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360064 00000100:00100000:0.0:1788970555.593962:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360576 00000100:00100000:0.0:1788970555.593964:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360576 00000100:00100000:0.0:1788970555.593977:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082359936 00000100:00100000:0.0:1788970555.593980:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082359936 00000100:00100000:2.0:1788970555.594145:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082359808 00000100:00100000:2.0:1788970555.594150:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082359808 00000100:00100000:2.0:1788970555.594182:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 166 00000100:00100000:2.0:1788970555.594191:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2400:x1875871082359808:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970555.594264:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2400:x1875871082359808:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 74us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970555.594272:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 166 00000100:00100000:2.0:1788970555.594304:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360320 00000100:00100000:2.0:1788970555.594307:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360320 00000100:00100000:2.0:1788970555.594329:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360832 00000100:00100000:2.0:1788970555.594332:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360832 00000100:00100000:2.0:1788970555.594342:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360192 00000100:00100000:2.0:1788970555.594344:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360192 00000100:00100000:2.0:1788970555.594354:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360704 00000100:00100000:2.0:1788970555.594357:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360704 00000100:00100000:2.0:1788970555.594369:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:2.0:1788970555.594408:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2400:x1875871082360320:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970555.594436:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf5170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2400:x1875871082360320:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970555.594443:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:2.0:1788970555.594455:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1788970555.594461:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082360832:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970555.594483:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082360832:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970555.594489:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1788970555.594499:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1788970555.594504:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082360192:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970555.594525:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082360192:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970555.594530:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:2.0:1788970555.594541:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:2.0:1788970555.594547:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082360704:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970555.594569:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082360704:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 21us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970555.594574:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970555.594968:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360448 00000100:00100000:0.0:1788970555.594974:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360448 00000100:00100000:0.0:1788970555.595053:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:0.0:1788970555.595060:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082360064:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970555.595118:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2400:x1875871082360064:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 58us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970555.595125:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:0.0:1788970555.595140:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1788970555.595146:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082360576:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970555.595167:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082360576:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 22us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970555.595173:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1788970555.595183:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970555.595188:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:2400:x1875871082359936:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970555.595223:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:2400:x1875871082359936:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 35us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970555.595229:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970555.595240:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00100000:0.0:1788970555.595245:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2400:x1875871082360448:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970555.595267:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2400:x1875871082360448:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970555.595273:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 65 00000100:00080000:0.0:1788970555.595303:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970555.595308:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970555.595311:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970555.595313:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 Debug log: 42228 lines, 42228 kept, 0 dropped, 0 bad.